-- Logs begin at Wed 2022-08-31 10:11:05 UTC, end at Wed 2022-08-31 11:14:58 UTC. -- Aug 31 10:45:36.587917 dv-cinder-795785-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 10:45:36.596994 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 10:45:36 2022] *** Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: nodename: dv-cinder-795785-12-iscsi Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: machine: x86_64 Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: clock source: unix Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: pcre jit disabled Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: detected number of CPU cores: 4 Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: current working directory: / Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: detected binary path: /usr/bin/uwsgi-core Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: your processes number limit is 47680 Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: your memory page size is 4096 bytes Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: detected max file descriptor number: 2048 Aug 31 10:45:36.599010 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: lock engine: pthread robust mutexes Aug 31 10:45:36.599947 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: thunder lock: enabled Aug 31 10:45:36.599947 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 10:45:36.599947 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 10:45:36.638148 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: Python main interpreter initialized at 0x55af0887b9c0 Aug 31 10:45:36.638148 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: python threads support enabled Aug 31 10:45:36.638148 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: your server socket listen backlog is limited to 100 connections Aug 31 10:45:36.638148 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: your mercy for graceful operations on workers is 90 seconds Aug 31 10:45:36.638526 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 10:45:36.638526 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: *** Operational MODE: preforking *** Aug 31 10:45:36.638812 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: *** uWSGI is running in multiple interpreter mode *** Aug 31 10:45:36.638812 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: spawned uWSGI master process (pid: 105466) Aug 31 10:45:36.639015 dv-cinder-795785-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 10:45:36.641799 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: spawned uWSGI worker 1 (pid: 105467, cores: 1) Aug 31 10:45:36.641799 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: spawned uWSGI worker 2 (pid: 105468, cores: 1) Aug 31 10:45:36.641799 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 10:45:37.290902 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 10:45:37.291530 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 10:45:38.361486 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:45:38.361486 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: from cryptography.utils import int_from_bytes Aug 31 10:45:38.362342 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:45:38.362342 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: from cryptography.utils import int_from_bytes Aug 31 10:45:38.365159 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:45:38.365159 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: from cryptography.utils import int_from_bytes Aug 31 10:45:38.365617 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:45:38.365617 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: from cryptography.utils import int_from_bytes Aug 31 10:45:40.823852 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:45:40.824470 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:45:40.824828 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:45:40.824917 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:45:40.825000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:45:40.825091 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:45:40.825178 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:45:40.825264 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:45:40.825348 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:45:40.825426 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:45:40.825600 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.825713 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.825933 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.826080 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.826264 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.826362 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.826568 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.826712 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.826869 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.826968 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.827208 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.827351 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.827488 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.827581 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.827839 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.828013 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.828130 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.828251 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.828375 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.828487 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.828706 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.828880 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.829008 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-12-iscsi {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.829156 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-12-iscsi {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.829288 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.829417 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.829616 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.829831 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.830002 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.830143 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.830289 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.830420 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.830551 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.830679 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.830809 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.830960 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.831089 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.831220 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.831593 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.832920 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.832920 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.833100 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.833241 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.833375 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.833505 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.833647 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.833647 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.833915 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.833998 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.834081 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.834173 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.834298 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.834433 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.834521 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.834591 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.834728 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.834859 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.834989 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.835078 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.835210 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.835308 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-12-iscsi {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.835440 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-12-iscsi {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.835531 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.835611 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.835746 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.835835 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.836019 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.836165 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.836431 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.836583 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.836685 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.836775 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.837024 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.837168 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.837344 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.837485 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.837678 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.837846 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.837959 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.838069 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.838322 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.838466 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.838643 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.838784 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.838982 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.839092 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.839261 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.839404 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.839570 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.839703 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.839854 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.839958 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.840158 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.840262 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.840475 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.840626 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.840775 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.840918 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.841051 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.841188 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.841328 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.841499 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.841867 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.842027 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.842198 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.842350 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.842498 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.842645 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.842791 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.842932 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.843079 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.843223 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.843361 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.843511 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.843674 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.843821 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.843965 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.844103 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.844270 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.844605 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.844757 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.844901 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.844901 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.845166 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.845314 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.845459 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.845608 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.845816 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.845962 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.846122 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.846919 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.847080 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.847177 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.847313 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.847451 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.847590 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.847768 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.847905 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.848049 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.848183 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.848183 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.848449 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.848581 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.848719 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.848865 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.849006 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.849155 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.849299 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.849439 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.849578 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.849710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.849920 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850019 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850108 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850187 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850264 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850353 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850433 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850520 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850605 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850693 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850777 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850864 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.850948 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.851035 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.851114 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.851199 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.851284 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.851443 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.851590 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.851778 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.851879 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.851967 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.852058 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.852269 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.852418 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.852562 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.852665 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.852879 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.853064 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.853185 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.853285 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.853518 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.853663 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.853797 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.853889 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.854124 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.854376 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.854474 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.854582 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.854727 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.854809 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.854977 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.855077 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.855275 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.855371 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.855571 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.855662 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.855873 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.855963 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.856171 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.856266 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.856466 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.856555 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.856760 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.856855 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.857071 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.857160 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.857384 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.857472 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.857688 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.857805 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.858011 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.858101 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.858311 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.858420 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.858608 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.858711 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.858918 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.859008 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.859219 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.859309 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.859517 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.859605 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.859835 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.859935 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.860120 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.860240 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.860420 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.860543 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.860751 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.860859 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.861040 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.861158 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.861342 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.861457 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.861659 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.861782 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.861984 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.862089 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.862289 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.862374 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.862602 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.862693 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.862905 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.862999 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.863204 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.863290 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.863505 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.863593 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.863802 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.863895 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.864099 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.864185 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.864395 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.864491 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.864692 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.864838 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.864993 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.865078 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.865284 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.865375 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.865591 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.865682 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.865931 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.866019 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.866238 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.866323 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.866538 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.866629 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.866834 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.866922 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.867145 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.867230 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:45:40.867474 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.867559 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.867797 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.867892 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.868136 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.868226 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.868445 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.868540 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.868797 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.868884 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.869126 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.869225 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.869437 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.869528 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.869743 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.869914 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.870071 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.870170 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.870391 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.870482 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.870697 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.870783 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.871002 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.871101 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.871307 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.871399 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.871621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.871713 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.871930 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.872035 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.872253 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.872340 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.872563 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.872647 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.872874 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.872970 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.873184 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.873268 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.873487 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.873570 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.873825 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.873995 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.874147 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.874241 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.874463 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.874549 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.874767 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.874897 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.875099 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.875185 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.875436 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.875529 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.875745 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.875843 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.876060 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.876145 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.876377 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.876460 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.876686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.876797 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.876991 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.877101 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.877294 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.877390 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.877606 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.877701 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.877952 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.878058 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.878257 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.878362 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.878573 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.878674 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.878877 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.878978 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.879192 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.879296 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.879497 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.879591 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.879800 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.879893 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.880102 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.880204 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.880405 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.880501 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.880711 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.880810 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.881034 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.881136 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.881343 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.881439 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.881657 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.881750 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.881988 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.882092 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.882298 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.882403 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.882611 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.882706 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.882912 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.883021 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.883214 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.883312 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.883515 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.883609 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.883811 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.883898 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.884106 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.884191 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.884456 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.884545 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.884759 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.884846 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.885059 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.885162 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.885376 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.885461 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.885697 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.885821 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.886036 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.886135 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.886348 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.886444 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.886649 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.886755 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.886957 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.887050 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.887258 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.887378 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.887565 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.887668 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.887865 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.887958 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.888168 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.888262 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.888474 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.888564 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.888773 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.888864 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.889091 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.889189 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.889395 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.889497 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.889695 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.889811 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.890034 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.890121 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.890345 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.890453 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.890687 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.890776 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.891005 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.891091 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.891315 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.891405 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.891623 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.891708 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.891929 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.892022 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.892249 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.892333 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.892575 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.892666 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.892881 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.892967 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.893189 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.893273 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.893515 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.893611 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.893864 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.893954 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.894170 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.894255 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.894490 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.894661 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.894811 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.894898 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.895126 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.895298 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.895443 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.895590 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.895738 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.895872 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.896007 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.896171 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.896311 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.896453 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.896592 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.896740 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.896960 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.897094 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.897237 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.897371 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.897510 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.897654 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.897805 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.897945 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.898106 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.898241 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.898373 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.898505 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.898637 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.898770 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.898910 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.899043 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.899192 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.899324 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.899477 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.899611 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.899775 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.899920 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.900138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.900279 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.900422 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.900572 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.900761 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.900896 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.901090 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.901221 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.901405 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.901542 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.901723 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.901888 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.902052 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.902182 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.902366 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.902494 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.902674 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.902759 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.902979 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.903065 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.903284 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.903386 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.903589 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.903675 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.903903 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.903987 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.904206 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.904292 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.904524 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.904612 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.904826 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.904910 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.905143 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.905283 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.905447 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.905532 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.905792 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.905915 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.906094 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.906231 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.906411 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.906525 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.906749 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.906861 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.907083 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.907180 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.907398 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.907485 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.907718 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.907812 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.908028 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.908114 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.908340 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.908424 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.908648 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.908746 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.908957 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.909042 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.909257 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.909342 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.909562 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.909660 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.909896 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.909988 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.910202 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.910298 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.910518 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.910617 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.910830 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.910924 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.911150 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.911234 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.911461 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.911555 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.911777 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.911862 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.912077 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.912170 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.912388 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.912472 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.912707 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.912793 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.913033 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.913116 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.913337 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.913422 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.913642 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.913727 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.913984 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.914084 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.914289 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.914381 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.914594 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.914679 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.914898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.914985 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.915213 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.915306 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.915526 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.915614 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.915859 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.915962 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.916177 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.916265 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.916489 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.916586 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.916793 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.916890 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.917158 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.917255 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.917396 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.917482 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.917697 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.917812 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.918020 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.918106 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.918319 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.918404 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.918622 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.918720 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.918937 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.919037 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.919248 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.919341 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.919561 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.919655 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.919876 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.919961 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.920175 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.920260 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.920474 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.920570 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.920789 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.920883 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.921094 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.921180 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.921392 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.921478 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.921690 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.921797 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.922027 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.922114 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.922374 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.922462 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.922686 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.922778 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.922988 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.923074 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.923304 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.923391 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.923627 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.923719 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.923932 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.924024 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.924245 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.924338 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.924551 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.924644 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.924857 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.924959 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.925174 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.925266 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.925485 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.925585 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.925806 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.925910 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.926115 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.926201 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.926421 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.926514 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.926725 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.926819 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.927031 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.927117 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.927350 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.927447 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.927652 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.927738 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.927959 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.928043 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.928264 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.928349 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.928561 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.928655 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.928863 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.928949 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.929176 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.929266 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.929755 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.929913 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.930102 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.930199 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.930412 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.930591 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.930730 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.930866 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.931033 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.931144 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.931395 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.931499 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.931720 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.931823 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.932043 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.932130 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.932349 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.932434 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.932650 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.932736 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.932953 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.933040 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.933252 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.933344 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.933549 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.933641 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.933880 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.933968 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.934179 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.934265 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.934478 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.934571 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.934775 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.934859 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.935079 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.935164 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.935377 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.935480 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.935679 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.935772 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.935974 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.936058 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.936271 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.936366 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.936579 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.936665 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.936879 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.936973 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.937184 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.937278 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.937481 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.937575 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.937808 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.937895 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.938119 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.938206 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.938422 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.938506 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.938722 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.938807 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.939025 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.939120 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.939358 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.939442 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.939664 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.939749 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.939996 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.940083 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.940319 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.940423 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.940655 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.940750 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.940956 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.941041 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.941256 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.941340 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.941574 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.941672 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.941899 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.941998 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.942199 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.942285 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.942497 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.942591 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.942800 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.942934 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.943104 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.943199 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.943402 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.943499 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.943706 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.943790 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.944016 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.944108 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.944320 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.944415 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.944624 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.944710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.944924 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.945009 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.945227 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.945322 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.945894 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.945983 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.946208 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.946302 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.946511 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.946641 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.946863 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.946954 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.947167 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.947252 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.947481 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.947602 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.947785 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.947892 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.948083 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.948183 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.948387 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.948485 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.948685 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.948788 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.948993 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.949096 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.949293 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.949388 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.949593 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.949695 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.949913 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.950026 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.950217 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.950303 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.950521 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.950608 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.950821 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.950916 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.951138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.951224 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.951445 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.951530 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.951744 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.951841 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.952042 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.952128 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.952347 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.952432 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.952649 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.952796 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.952951 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.953093 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.953258 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.953390 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.953579 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.953713 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.953920 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.954024 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.954223 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.954345 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.954530 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.954619 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.954839 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.954923 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.955144 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.955229 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.955443 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.955569 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.955746 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.955845 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.956045 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.956147 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.956338 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.956429 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.956635 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.956751 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.956935 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.957032 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.957237 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.957330 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.957558 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.957685 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.957886 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.957988 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.958191 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.958277 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.958496 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.958580 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.958794 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.958888 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.959136 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.959220 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.959433 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.959525 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.959787 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.959873 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.960089 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.960174 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.960808 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.960893 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.960969 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.961035 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.961106 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.961171 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.961289 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.961371 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.961595 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.961670 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.962195 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.962364 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.962555 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.962725 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.962725 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.963009 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.963157 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.963244 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.963367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.963672 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.963996 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.964304 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.964725 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.964847 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.964925 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.965070 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.965246 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.965437 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.965554 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.965799 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.965896 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.966133 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.966222 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.966470 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.966566 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.966773 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.966870 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.967082 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.967176 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.967385 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.967474 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.967696 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.967844 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.967985 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.968123 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.968293 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.968436 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.968599 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.968741 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.968886 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.969020 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.969190 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.969321 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.969501 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.969643 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.969836 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.969924 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.970138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.970237 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.970461 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.970562 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.970766 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.970860 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.971066 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.971159 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.971370 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.971465 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.971671 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.971757 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.971978 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.972070 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.972276 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.972409 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.972650 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.972766 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.972963 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.973051 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.973271 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.973357 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.973578 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.973662 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.973907 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.974010 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.974216 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.974341 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.974532 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.974659 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.974844 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.974977 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.975147 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.975286 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.975559 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.975664 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.975880 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.975976 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.976197 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.976308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.976499 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.976595 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.976800 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.976979 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.977102 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.977224 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.977408 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.977545 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.977728 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.977929 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.978077 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.978240 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.978378 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.978550 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.978677 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.978860 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.978994 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.979174 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.979295 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.979504 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.979863 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.979964 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.980108 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.980193 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.980415 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.980520 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.980715 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.980808 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.981037 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.981129 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.981360 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.981452 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.981711 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.981818 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.982054 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.982153 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.982371 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.982465 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.982691 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.982798 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.982996 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.983096 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.983307 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.983413 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.983610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.983738 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.983928 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.984062 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.984245 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.984386 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.984549 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.984693 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.984859 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.985008 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.985159 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.985317 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.985478 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.985642 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.985819 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.986003 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.986131 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.986316 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.986445 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.986633 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.986856 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.986942 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.987182 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.987276 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.987490 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.987579 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.987807 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.987892 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.988127 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.988222 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.988427 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.988575 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.988724 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.988900 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.989025 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.989211 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.989326 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.989532 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.989617 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.989885 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.989972 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.990197 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.990292 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.990502 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.990595 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.990818 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.990907 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.991116 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.991201 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.991414 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.991507 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.991712 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.991797 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.992033 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.992119 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.992331 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.992416 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.992640 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.992725 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.992946 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.993031 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.993247 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.993332 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.993559 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.993732 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.993931 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.994035 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.994251 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.994336 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.994558 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.994656 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.994856 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.994953 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.995153 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.995238 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.995452 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.995545 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.995780 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.995865 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.996087 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.996180 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.996399 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.996494 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.996701 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.996785 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.997005 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.997090 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.997308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.997402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.997642 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.997735 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.997972 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.998110 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.998296 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.998391 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.998606 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.998690 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.998927 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.999020 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.999227 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.999313 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.999531 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.999616 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.999879 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:40.999964 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.000202 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.000303 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.000520 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.000606 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.000819 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.000905 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.001124 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.001210 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.001423 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.001509 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.001722 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.001872 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.002046 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.002140 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.002350 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.002443 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.002652 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.002744 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.002961 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.003045 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.003266 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.003351 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.003573 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.003665 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.003871 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.003956 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.004176 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.004260 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.004480 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.004573 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.004800 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.004884 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.005108 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.005201 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.005413 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.005499 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.005720 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.005824 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.006051 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.006194 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.006361 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.006463 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.006674 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.006759 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.006984 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.007113 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.007295 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.007397 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.007613 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.007699 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.007924 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.008010 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.008226 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.008321 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.008535 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.008621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.008844 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.008937 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.009152 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.009239 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.009494 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.009713 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.009854 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.010063 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.010159 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.010373 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.010467 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.010687 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.010773 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.010995 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.011083 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.011305 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.011562 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.011648 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.011896 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.011994 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.012201 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.012285 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.012506 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.012592 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.012812 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.012898 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.013124 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.013208 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.013438 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.013531 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.013752 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.013861 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.014085 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.014182 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.014403 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.014489 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.014714 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.014800 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.015021 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.015112 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.015352 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.015497 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.015678 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.015766 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.016020 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.016106 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.016347 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.016512 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.016663 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.016752 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.016970 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.017054 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.017282 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.017369 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.017588 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.017681 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.017922 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.018012 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.018243 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.018331 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.018552 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.018640 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.018862 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.018958 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.019163 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.019249 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.019470 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.019565 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.019778 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.019871 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.020092 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.020177 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.020408 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.020493 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.020722 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.020830 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.021025 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.021109 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.021333 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.021420 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.021642 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.021735 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.021990 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.022172 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.022324 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.022482 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.022645 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.022812 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.022960 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.023136 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.023272 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.023455 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.023585 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.023775 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.024086 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.024189 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.024405 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.024493 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.024706 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.024799 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.025066 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.025164 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.025370 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.025480 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.025690 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.025846 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.026004 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.026120 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.026321 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.026431 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.026626 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.026727 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.026925 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.027021 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.027231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.027333 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.027532 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.027617 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.027834 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.028057 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.028146 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.028406 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.028505 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.028720 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.028816 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.029040 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.029136 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.029348 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.029432 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.029663 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.029899 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.030003 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.030251 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.030339 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.030568 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.030664 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.030896 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.030983 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.031222 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.031316 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.031537 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.031624 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.031843 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.031929 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.032148 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.032235 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.032457 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.032543 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.032760 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.032855 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.033058 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.033145 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.033363 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.033458 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.033663 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.033786 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.033992 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.034096 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.034302 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.034389 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.034604 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.034698 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.034906 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.034993 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.035211 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.035304 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.035510 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.035608 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.035814 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.035900 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.036111 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.036196 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.036412 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.036566 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.036706 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.036914 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.037058 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.037191 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.037331 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.037465 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.037600 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.037742 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.037927 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.038071 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.038223 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.038368 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.038549 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.038639 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.038776 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.038924 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.039082 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.039245 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.039547 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.039695 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.039846 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.039999 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.040161 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.040305 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.040479 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.040679 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.040802 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.041008 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.041114 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.041312 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.041418 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.041613 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.041757 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.041966 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.042088 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.042275 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.042596 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.042682 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.042908 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.043005 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.043217 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.043303 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.043548 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.043641 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.043862 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.044004 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.044165 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.044394 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.044480 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.044734 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.044821 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.045057 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.045149 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.045365 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.045459 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.045672 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.045759 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.046002 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.046089 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.046309 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.046406 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.046618 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.046720 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.046925 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.047037 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.047228 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.047392 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.047533 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.047635 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.047836 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.047923 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.048138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.048235 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.048440 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.048527 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.048744 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.048881 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.049029 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.049175 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.049338 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.049483 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.049641 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.049803 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.049991 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.050124 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.050300 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.050436 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.050611 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.050716 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.050926 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.051015 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.051235 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.051321 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.051548 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.051633 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.051873 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.051959 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.052179 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.052266 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.052485 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.052580 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.052793 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.052885 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.053107 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.053192 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.053414 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.053510 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.053710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.053856 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.054048 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.054192 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.054355 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.054495 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.054667 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.054808 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.054996 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.055128 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.055310 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.055442 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.055613 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.055751 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.055938 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.056090 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.056293 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.056428 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.056610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.056752 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.056917 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.057070 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.057245 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.057377 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.057579 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.057719 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.057927 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.058027 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.058239 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.058324 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.058539 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.058633 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.058842 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.058951 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.059144 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.059230 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.059452 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.059539 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.059766 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.059860 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.060069 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.060156 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.060367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.060461 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.060667 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.060754 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.060969 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.061056 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.061269 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.061354 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.061567 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.061654 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.061889 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.061993 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.062188 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.062274 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.062490 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.062575 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.062788 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.062873 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.063087 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.063172 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.063385 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.063472 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.063681 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.063776 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.063978 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.064073 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.064276 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.064365 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.064573 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.064657 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.064868 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.064961 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.065165 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.065251 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.065461 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.065546 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.065760 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.065872 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.066079 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.066164 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.066383 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.066467 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.066686 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.066823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.066988 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.067074 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.067289 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.067383 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.067589 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.067675 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.067890 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.067977 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.068205 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.068298 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.068519 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.068612 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.068839 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.068924 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.069150 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.069244 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.069454 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.069541 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.069792 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.069880 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.070099 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.070183 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.070740 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.070841 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.071053 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.071140 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.071360 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.071454 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.071667 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.071773 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.071996 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.072082 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.072314 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.072416 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.072626 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.072721 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.072927 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.073019 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.073235 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.073329 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.073545 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.073631 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.073924 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.074023 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.074185 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.074309 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.074481 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.074576 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.074803 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.074887 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.075106 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.075192 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.075410 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.075497 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.075714 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.075799 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.076025 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.076112 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.076333 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.076418 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.076641 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.076735 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.076946 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.077048 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.077273 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.077367 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.077550 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.077690 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.077883 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.077972 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.078195 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.078290 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.078505 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.078604 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.078813 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.078945 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.079119 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.079213 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.079432 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.079527 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.079742 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.079835 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.080067 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.080159 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.080394 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.080481 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.080703 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.080788 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.081031 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.081125 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.081342 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.081428 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.081641 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.081727 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.081901 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105468) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:45:41.082024 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.082364 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.082690 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.083002 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.083312 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.083616 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:45:41.083856 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105467) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:45:41.238257 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO dbcounter [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Registered counter for database nova_api Aug 31 10:45:41.242885 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO dbcounter [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Registered counter for database nova_api Aug 31 10:45:41.260199 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_db.sqlalchemy.engines [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:45:41.262759 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_db.sqlalchemy.engines [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:45:41.267104 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writer thread running {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:45:41.269315 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writer thread running {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:45:41.324159 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.context [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05e8ed1e-1228-4051-ab88-71c736654b3f(cell1) {{(pid=105468) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 10:45:41.327499 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.context [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05e8ed1e-1228-4051-ab88-71c736654b3f(cell1) {{(pid=105467) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 10:45:41.327992 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:45:41.328474 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:45:41.330134 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:45:41.330837 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:45:41.331304 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:45:41.331438 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:45:41.331844 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:45:41.333310 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:45:41.333446 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:45:41.334150 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:45:41.334589 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:45:41.335328 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO dbcounter [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Registered counter for database nova_cell0 Aug 31 10:45:41.336559 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_concurrency.lockutils [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105467) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:45:41.338550 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO dbcounter [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Registered counter for database nova_cell0 Aug 31 10:45:41.339416 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO dbcounter [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Registered counter for database nova_cell1 Aug 31 10:45:41.342485 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO dbcounter [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Registered counter for database nova_cell1 Aug 31 10:45:41.348206 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_db.sqlalchemy.engines [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:45:41.349094 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_db.sqlalchemy.engines [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:45:41.354283 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_db.sqlalchemy.engines [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:45:41.354463 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writer thread running {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:45:41.355041 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_db.sqlalchemy.engines [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:45:41.357005 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writer thread running {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:45:41.361923 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writer thread running {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:45:41.363356 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writer thread running {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:45:41.499325 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO dbcounter [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Registered counter for database nova_cell0 Aug 31 10:45:41.504467 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO dbcounter [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Registered counter for database nova_cell0 Aug 31 10:45:41.508709 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_db.sqlalchemy.engines [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105468) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:45:41.511613 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG oslo_db.sqlalchemy.engines [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105467) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:45:41.514086 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writer thread running {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:45:41.516847 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writer thread running {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:45:41.848506 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: WARNING keystonemiddleware.auth_token [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:45:41.851888 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: WARNING keystonemiddleware.auth_token [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:45:41.856004 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: WARNING keystonemiddleware.auth_token [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:45:41.859381 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: WARNING keystonemiddleware.auth_token [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:45:42.199054 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: WARNING keystonemiddleware.auth_token [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:45:42.205154 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: WARNING keystonemiddleware.auth_token [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:45:42.205898 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: WARNING keystonemiddleware.auth_token [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:45:42.210425 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55af0887b9c0 pid: 105468 (default app) Aug 31 10:45:42.211881 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: WARNING keystonemiddleware.auth_token [None req-072fc34c-1c4a-483c-8ebc-d377ff39f8e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:45:42.212484 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:45:42.213719 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001770 Aug 31 10:45:42.214156 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Wed Aug 31 10:45:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:45:42.217329 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55af0887b9c0 pid: 105467 (default app) Aug 31 10:47:00.344591 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:00.345651 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 31 10:47:00.346381 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:00.358687 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_api:SELECT=3 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:00.359548 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_cell1:SELECT=3 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:00.360253 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_cell0:SELECT=3 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:00.361436 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:01.244156 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-1360d4fc-de91-4b4b-ad63-cc9ce52d235c admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:01.276287 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-1360d4fc-de91-4b4b-ad63-cc9ce52d235c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922738 Aug 31 10:47:01.277063 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1292 bytes} [Wed Aug 31 10:47:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:47:03.588091 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:03.588091 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-cdf7ca31-ac74-4ce5-bf49-0a93592324a8 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 31 10:47:03.589144 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:04.038372 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-97966c66-1c1b-47c4-bf06-4ba604692022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:04.092477 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-97966c66-1c1b-47c4-bf06-4ba604692022 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497089 Aug 31 10:47:04.093668 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 10:47:04.108680 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:SELECT=3 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:04.109590 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell1:SELECT=3 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:04.110659 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell0:SELECT=3 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:04.111968 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:04.318878 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-ead6376b-ef93-4a8f-8cb2-de15945bb11c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:04.385289 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-ead6376b-ef93-4a8f-8cb2-de15945bb11c admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282990 Aug 31 10:47:04.386115 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1336 bytes} [Wed Aug 31 10:47:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:47:06.724756 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-97966c66-1c1b-47c4-bf06-4ba604692022 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:06.725854 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-97966c66-1c1b-47c4-bf06-4ba604692022 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Aug 31 10:47:06.726448 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:07.388010 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-ed4fb824-0570-474b-a893-385c60dccbd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "d1", "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:07.430758 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-ed4fb824-0570-474b-a893-385c60dccbd2 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.697402 Aug 31 10:47:07.431312 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:47:07.444397 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-70fc2758-5bfc-4bdb-beab-ad3294956d89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:07.484472 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-70fc2758-5bfc-4bdb-beab-ad3294956d89 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044059 Aug 31 10:47:07.485285 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1336 bytes} [Wed Aug 31 10:47:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:47:09.844274 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-ed4fb824-0570-474b-a893-385c60dccbd2 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:09.845224 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-ed4fb824-0570-474b-a893-385c60dccbd2 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Aug 31 10:47:09.845638 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:47:10.257049 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-91af0127-0aa4-453b-b945-8527177d0ba3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:10.278131 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-91af0127-0aa4-453b-b945-8527177d0ba3 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426044 Aug 31 10:47:10.278677 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:47:10.291159 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-a3ea96ca-b9b7-42f4-af81-14b8184e3517 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:10.317728 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-a3ea96ca-b9b7-42f4-af81-14b8184e3517 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030307 Aug 31 10:47:10.318682 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1336 bytes} [Wed Aug 31 10:47:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:47:12.667002 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-91af0127-0aa4-453b-b945-8527177d0ba3 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:12.668699 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-91af0127-0aa4-453b-b945-8527177d0ba3 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002215 Aug 31 10:47:12.669322 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:13.158998 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-dd003d30-f3e6-4991-b8b9-e15a588be0bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "ram": 2048}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:13.181617 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-dd003d30-f3e6-4991-b8b9-e15a588be0bd admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.505614 Aug 31 10:47:13.182842 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:47:13.194978 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-807714d7-0dbb-474f-9886-9f7577226673 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:13.222138 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-807714d7-0dbb-474f-9886-9f7577226673 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030689 Aug 31 10:47:13.222761 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1336 bytes} [Wed Aug 31 10:47:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:47:15.590952 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-dd003d30-f3e6-4991-b8b9-e15a588be0bd admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:15.591868 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-dd003d30-f3e6-4991-b8b9-e15a588be0bd admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 31 10:47:15.592230 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:16.032097 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-9fe47360-ea1b-44f3-8c0a-d7727ec01624 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "swap": 0}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:16.051951 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-9fe47360-ea1b-44f3-8c0a-d7727ec01624 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452772 Aug 31 10:47:16.052490 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:47:16.064680 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-48adf58b-9cec-46ef-b0e4-2c9971e7f0bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:16.090499 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-48adf58b-9cec-46ef-b0e4-2c9971e7f0bc admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029468 Aug 31 10:47:16.091093 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1336 bytes} [Wed Aug 31 10:47:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:47:18.561817 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-9fe47360-ea1b-44f3-8c0a-d7727ec01624 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:18.563033 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-9fe47360-ea1b-44f3-8c0a-d7727ec01624 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Aug 31 10:47:18.563510 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:18.978620 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-e0e9a6f5-a0d1-4677-b511-acab91bc74e2 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:19.004006 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-e0e9a6f5-a0d1-4677-b511-acab91bc74e2 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.433990 Aug 31 10:47:19.004558 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1292 bytes} [Wed Aug 31 10:47:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:47:21.405256 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-9fe47360-ea1b-44f3-8c0a-d7727ec01624 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:21.406316 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-9fe47360-ea1b-44f3-8c0a-d7727ec01624 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Aug 31 10:47:21.406734 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:21.866154 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-80e240ad-704d-48dd-8edf-b0dc17f0a7ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:21.887064 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-80e240ad-704d-48dd-8edf-b0dc17f0a7ab admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.471675 Aug 31 10:47:21.887626 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:47:21.903849 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-8da63ed6-aeec-4cc7-86b6-4844f056d940 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:21.936045 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-8da63ed6-aeec-4cc7-86b6-4844f056d940 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037094 Aug 31 10:47:21.936637 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1333 bytes} [Wed Aug 31 10:47:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:47:24.341369 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-80e240ad-704d-48dd-8edf-b0dc17f0a7ab admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:24.342444 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-80e240ad-704d-48dd-8edf-b0dc17f0a7ab admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Aug 31 10:47:24.342847 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:24.749375 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-056d5422-6a36-4136-aace-a544afc54aa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "name": "m1.small", "rxtx_factor": 1.0}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:24.769385 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-056d5422-6a36-4136-aace-a544afc54aa0 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420172 Aug 31 10:47:24.769979 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:47:24.782382 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-b8960846-9540-4bfa-88a5-531851c52f7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:24.806376 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-b8960846-9540-4bfa-88a5-531851c52f7d admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027914 Aug 31 10:47:24.806941 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1333 bytes} [Wed Aug 31 10:47:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:47:27.143187 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-056d5422-6a36-4136-aace-a544afc54aa0 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:27.144204 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-056d5422-6a36-4136-aace-a544afc54aa0 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 31 10:47:27.144652 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:27.541397 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-52df7998-6e4d-4a2c-95cc-9f897639612f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:27.562563 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-52df7998-6e4d-4a2c-95cc-9f897639612f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.410909 Aug 31 10:47:27.563221 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:47:27.575329 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-91c34bca-1063-46c2-b49e-fd6832a7b5e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:27.602343 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-91c34bca-1063-46c2-b49e-fd6832a7b5e3 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030567 Aug 31 10:47:27.605912 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1333 bytes} [Wed Aug 31 10:47:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:47:29.979071 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-52df7998-6e4d-4a2c-95cc-9f897639612f admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:29.980789 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-52df7998-6e4d-4a2c-95cc-9f897639612f admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002141 Aug 31 10:47:29.981187 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:30.412199 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-08f5ca57-0910-4e1a-b08e-2a9663dfbc1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "disk": 80, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:30.420259 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:30.434619 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-08f5ca57-0910-4e1a-b08e-2a9663dfbc1f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446290 Aug 31 10:47:30.435526 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:47:30.447729 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-7b00ccd6-9838-402f-a191-e1ec1613d4a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:30.476821 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-7b00ccd6-9838-402f-a191-e1ec1613d4a8 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033091 Aug 31 10:47:30.477418 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1333 bytes} [Wed Aug 31 10:47:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:47:32.865742 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-08f5ca57-0910-4e1a-b08e-2a9663dfbc1f admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:32.867660 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-08f5ca57-0910-4e1a-b08e-2a9663dfbc1f admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002135 Aug 31 10:47:32.868177 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:33.306108 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-6b76a32a-d8a2-4156-9c04-f281dac03048 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:33.330069 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-6b76a32a-d8a2-4156-9c04-f281dac03048 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.455270 Aug 31 10:47:33.337806 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1283 bytes} [Wed Aug 31 10:47:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 10:47:33.343137 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-88c036c1-3df1-4178-a29b-65b1e75de1a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:33.373825 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-88c036c1-3df1-4178-a29b-65b1e75de1a1 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034334 Aug 31 10:47:33.374827 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1333 bytes} [Wed Aug 31 10:47:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:47:52.326965 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-6b76a32a-d8a2-4156-9c04-f281dac03048 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:52.328015 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-6b76a32a-d8a2-4156-9c04-f281dac03048 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 31 10:47:52.328427 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:47:52.344692 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:52.776159 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-64d81dba-1825-49ed-9ee0-1479ae09fe5c admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:52.802143 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-64d81dba-1825-49ed-9ee0-1479ae09fe5c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.464132 Aug 31 10:47:52.802681 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1292 bytes} [Wed Aug 31 10:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:47:53.885834 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-6b76a32a-d8a2-4156-9c04-f281dac03048 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:53.887157 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-6b76a32a-d8a2-4156-9c04-f281dac03048 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Aug 31 10:47:53.887619 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:54.456634 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-a65a2136-d332-4126-8765-4e4e4d7eb2a0 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:54.464888 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.wsgi [None req-a65a2136-d332-4126-8765-4e4e4d7eb2a0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-a65a2136-d332-4126-8765-4e4e4d7eb2a0 admin admin] Request method failure captured: Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Accept: application/json Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Accept-Encoding: gzip, deflate Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Connection: keep-alive Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Content-Length: 0 Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Host: 10.222.0.75 Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Openstack-Api-Version: compute 2.90 Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Openstack-System-Scope: None Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: User-Agent: python-novaclient Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Auth-Token: gAAAAABjDzxZF9Yx3vAefN31rFgASd1dvFpBo5rDzZT66AAR3VlY2NC5XtWga5LLazf0pf-t55FvnmGaZuQ6F6Z95s6cPg9MGc4nG2lRrTQs58SQDIQ0XHFPUB74RvrETcL9I3o7i4u485zpm1a_RY2Via6MN42ECmfcF9KXegurS9-S3gGg9YM Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Domain-Id: None Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Domain-Name: None Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Identity-Status: Confirmed Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Is-Admin-Project: True Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Domain-Id: default Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Domain-Name: Default Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Name: admin Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Role: reader,member,admin Aug 31 10:47:54.469410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Roles: reader,member,admin Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5efb11cead144cc7a5078ee4532b8260"}]}] Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Tenant: admin Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Tenant-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Tenant-Name: admin Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User: admin Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Domain-Id: default Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Domain-Name: Default Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Id: bd54da1432894173a79d520df35ac9c0 Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Name: admin Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: method: > Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: exception: Flavor 42 could not be found. Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: action_args: {'id': '42'} Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:47:54.470867 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:54.471710 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.472971 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-a65a2136-d332-4126-8765-4e4e4d7eb2a0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:47:54.474254 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-a65a2136-d332-4126-8765-4e4e4d7eb2a0 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.446574 Aug 31 10:47:54.474254 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Wed Aug 31 10:47:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:54.480810 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-5ac1b2a4-0bef-47cc-b419-fd3f629cb5cc admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:54.485868 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:54.506794 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-5ac1b2a4-0bef-47cc-b419-fd3f629cb5cc admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029578 Aug 31 10:47:54.507352 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Aug 31 10:47:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:47:54.517462 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-5eb75ff4-b337-4707-9e01-120a7fd95152 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:54.540172 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-5eb75ff4-b337-4707-9e01-120a7fd95152 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026410 Aug 31 10:47:54.540720 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Aug 31 10:47:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:47:54.550809 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-bbaae1c0-a296-48c8-91bc-ca73584b950b admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:54.556759 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.wsgi [None req-bbaae1c0-a296-48c8-91bc-ca73584b950b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-bbaae1c0-a296-48c8-91bc-ca73584b950b admin admin] Request method failure captured: Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Accept: application/json Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Accept-Encoding: gzip, deflate Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Connection: keep-alive Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Content-Length: 0 Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Host: 10.222.0.75 Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Openstack-Api-Version: compute 2.90 Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Openstack-System-Scope: None Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: User-Agent: python-novaclient Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Auth-Token: gAAAAABjDzxZF9Yx3vAefN31rFgASd1dvFpBo5rDzZT66AAR3VlY2NC5XtWga5LLazf0pf-t55FvnmGaZuQ6F6Z95s6cPg9MGc4nG2lRrTQs58SQDIQ0XHFPUB74RvrETcL9I3o7i4u485zpm1a_RY2Via6MN42ECmfcF9KXegurS9-S3gGg9YM Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Domain-Id: None Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Domain-Name: None Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Identity-Status: Confirmed Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Is-Admin-Project: True Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Domain-Id: default Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Domain-Name: Default Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Name: admin Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Role: reader,member,admin Aug 31 10:47:54.560121 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Roles: reader,member,admin Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5efb11cead144cc7a5078ee4532b8260"}]}] Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Tenant: admin Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Tenant-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Tenant-Name: admin Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User: admin Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Domain-Id: default Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Domain-Name: Default Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Id: bd54da1432894173a79d520df35ac9c0 Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Name: admin Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: method: > Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: exception: Flavor 42 could not be found. Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: action_args: {'id': '42'} Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:47:54.561710 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:54.562610 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:54.563625 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-bbaae1c0-a296-48c8-91bc-ca73584b950b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:47:54.564602 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-bbaae1c0-a296-48c8-91bc-ca73584b950b admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014722 Aug 31 10:47:54.564602 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Wed Aug 31 10:47:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:55.575669 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-5eb75ff4-b337-4707-9e01-120a7fd95152 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:55.576692 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-5eb75ff4-b337-4707-9e01-120a7fd95152 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001854 Aug 31 10:47:55.577114 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:56.129683 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-4d2727e2-9cb0-41e6-bd5e-97c34a9f6e01 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:56.135816 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.wsgi [None req-4d2727e2-9cb0-41e6-bd5e-97c34a9f6e01 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-4d2727e2-9cb0-41e6-bd5e-97c34a9f6e01 admin admin] Request method failure captured: Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Accept: application/json Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Accept-Encoding: gzip, deflate Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Connection: keep-alive Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Content-Length: 0 Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Host: 10.222.0.75 Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Openstack-Api-Version: compute 2.90 Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Openstack-System-Scope: None Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: User-Agent: python-novaclient Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Auth-Token: gAAAAABjDzxbMOAMQpkCxpavBYZhuCvz3-1KjHIm0y9EdK9mqtGu7cLKn62FqF1mxYugM80AHOOzzn7AryZd0r3SCBblwSTIt3sCa5_IG0wLhJfHEy1pwDzxsDwysHN3WLHtQvVBcjpALcFYXEJIYfJOUU2dpSiIBV_EMC7d3dRMzDNCTIqTifI Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Domain-Id: None Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Domain-Name: None Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Identity-Status: Confirmed Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Is-Admin-Project: True Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Domain-Id: default Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Domain-Name: Default Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Name: admin Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Role: reader,member,admin Aug 31 10:47:56.137367 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Roles: reader,member,admin Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5efb11cead144cc7a5078ee4532b8260"}]}] Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Tenant: admin Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Tenant-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Tenant-Name: admin Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User: admin Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Domain-Id: default Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Domain-Name: Default Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Id: bd54da1432894173a79d520df35ac9c0 Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Name: admin Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: method: > Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: exception: Flavor 84 could not be found. Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: action_args: {'id': '84'} Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:47:56.139301 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:56.140138 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.141402 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-4d2727e2-9cb0-41e6-bd5e-97c34a9f6e01 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:47:56.142668 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-4d2727e2-9cb0-41e6-bd5e-97c34a9f6e01 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.423475 Aug 31 10:47:56.142668 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Wed Aug 31 10:47:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:56.148848 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-a6f02b88-edce-482e-9342-d6297f228794 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:56.164450 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-a6f02b88-edce-482e-9342-d6297f228794 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019279 Aug 31 10:47:56.164954 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Aug 31 10:47:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:47:56.174536 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-0a68ff59-f8fb-4b02-8471-50dea974b508 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:56.189947 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-0a68ff59-f8fb-4b02-8471-50dea974b508 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019001 Aug 31 10:47:56.190441 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Aug 31 10:47:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:47:56.200217 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-b2c751d3-51b9-4fbc-b0a8-8d1c73cac406 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:56.207784 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.wsgi [None req-b2c751d3-51b9-4fbc-b0a8-8d1c73cac406 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-b2c751d3-51b9-4fbc-b0a8-8d1c73cac406 admin admin] Request method failure captured: Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Accept: application/json Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Accept-Encoding: gzip, deflate Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Connection: keep-alive Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Content-Length: 0 Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Host: 10.222.0.75 Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Openstack-Api-Version: compute 2.90 Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Openstack-System-Scope: None Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: User-Agent: python-novaclient Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Auth-Token: gAAAAABjDzxbMOAMQpkCxpavBYZhuCvz3-1KjHIm0y9EdK9mqtGu7cLKn62FqF1mxYugM80AHOOzzn7AryZd0r3SCBblwSTIt3sCa5_IG0wLhJfHEy1pwDzxsDwysHN3WLHtQvVBcjpALcFYXEJIYfJOUU2dpSiIBV_EMC7d3dRMzDNCTIqTifI Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Domain-Id: None Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Domain-Name: None Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Identity-Status: Confirmed Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Is-Admin-Project: True Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Domain-Id: default Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Domain-Name: Default Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Name: admin Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Role: reader,member,admin Aug 31 10:47:56.210231 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Roles: reader,member,admin Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5efb11cead144cc7a5078ee4532b8260"}]}] Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Tenant: admin Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Tenant-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Tenant-Name: admin Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User: admin Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Domain-Id: default Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Domain-Name: Default Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Id: bd54da1432894173a79d520df35ac9c0 Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Name: admin Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: method: > Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: exception: Flavor 84 could not be found. Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: action_args: {'id': '84'} Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:47:56.211822 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:56.212704 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:56.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-b2c751d3-51b9-4fbc-b0a8-8d1c73cac406 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:47:56.215127 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-b2c751d3-51b9-4fbc-b0a8-8d1c73cac406 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015378 Aug 31 10:47:56.215127 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Wed Aug 31 10:47:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 31 10:47:57.198370 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-0a68ff59-f8fb-4b02-8471-50dea974b508 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:57.199729 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-0a68ff59-f8fb-4b02-8471-50dea974b508 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 31 10:47:57.200163 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:47:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:57.814103 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-e2343154-f268-41b1-96ec-5db0321c8dda admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:57.823053 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.wsgi [None req-e2343154-f268-41b1-96ec-5db0321c8dda admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-e2343154-f268-41b1-96ec-5db0321c8dda admin admin] Request method failure captured: Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Accept: application/json Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Accept-Encoding: gzip, deflate Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Connection: keep-alive Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Content-Length: 0 Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Host: 10.222.0.75 Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Openstack-Api-Version: compute 2.90 Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Openstack-System-Scope: None Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: User-Agent: python-novaclient Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Auth-Token: gAAAAABjDzxdDmDkYeAwyRMVH-1c_dPRgiuy-0gyTl5esGmdNpqY2dgFQIaBfg4lzDEnMH2R1nUvjBgJDWGVrRrKPGVXI73LALOC2O8W9uJ6Rij9Ht7YZfVDxzdRKW5PnQU1KOHELDSuoLxo2-s0th44-uew6abc67-sc1BGKBmT1k7VRjAtSss Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Domain-Id: None Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Domain-Name: None Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Identity-Status: Confirmed Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Is-Admin-Project: True Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Domain-Id: default Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Domain-Name: Default Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Project-Name: admin Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Role: reader,member,admin Aug 31 10:47:57.825624 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Roles: reader,member,admin Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5efb11cead144cc7a5078ee4532b8260"}]}] Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Tenant: admin Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Tenant-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-Tenant-Name: admin Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User: admin Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Domain-Id: default Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Domain-Name: Default Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Id: bd54da1432894173a79d520df35ac9c0 Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: X-User-Name: admin Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: method: > Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: exception: Flavor 451 could not be found. Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: action_args: {'id': '451'} Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:47:57.827308 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:57.828369 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.829621 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-e2343154-f268-41b1-96ec-5db0321c8dda admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105467) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:47:57.830920 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-e2343154-f268-41b1-96ec-5db0321c8dda admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.481752 Aug 31 10:47:57.830920 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Aug 31 10:47:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 483 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:57.838157 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-2694ade7-64db-4bc6-93ea-836dc5c3904b admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:57.853859 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-2694ade7-64db-4bc6-93ea-836dc5c3904b admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019385 Aug 31 10:47:57.854441 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Aug 31 10:47:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:47:57.864608 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:57.880982 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019770 Aug 31 10:47:57.881526 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Wed Aug 31 10:47:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:47:57.891374 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-58c0c547-9724-47ae-82aa-d5af9a19d56e admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:57.897126 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.wsgi [None req-58c0c547-9724-47ae-82aa-d5af9a19d56e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-58c0c547-9724-47ae-82aa-d5af9a19d56e admin admin] Request method failure captured: Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Accept: application/json Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Accept-Encoding: gzip, deflate Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Connection: keep-alive Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Content-Length: 0 Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Host: 10.222.0.75 Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Openstack-Api-Version: compute 2.90 Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Openstack-System-Scope: None Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: User-Agent: python-novaclient Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Auth-Token: gAAAAABjDzxdDmDkYeAwyRMVH-1c_dPRgiuy-0gyTl5esGmdNpqY2dgFQIaBfg4lzDEnMH2R1nUvjBgJDWGVrRrKPGVXI73LALOC2O8W9uJ6Rij9Ht7YZfVDxzdRKW5PnQU1KOHELDSuoLxo2-s0th44-uew6abc67-sc1BGKBmT1k7VRjAtSss Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Domain-Id: None Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Domain-Name: None Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Identity-Status: Confirmed Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Is-Admin-Project: True Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Domain-Id: default Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Domain-Name: Default Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Project-Name: admin Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Role: reader,member,admin Aug 31 10:47:57.898686 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Roles: reader,member,admin Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/5efb11cead144cc7a5078ee4532b8260"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/5efb11cead144cc7a5078ee4532b8260"}]}] Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Tenant: admin Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Tenant-Id: 5efb11cead144cc7a5078ee4532b8260 Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-Tenant-Name: admin Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User: admin Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Domain-Id: default Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Domain-Name: Default Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Id: bd54da1432894173a79d520df35ac9c0 Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: X-User-Name: admin Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: method: > Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: exception: Flavor 451 could not be found. Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: action_args: {'id': '451'} Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:47:57.900049 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:57.900823 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: ERROR nova.api.openstack.wsgi Aug 31 10:47:57.901898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-58c0c547-9724-47ae-82aa-d5af9a19d56e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105468) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:47:57.903280 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-58c0c547-9724-47ae-82aa-d5af9a19d56e admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012434 Aug 31 10:47:57.903280 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Aug 31 10:47:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:58.882129 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:47:58.883156 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 31 10:47:58.883548 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:47:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:47:59.450226 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-fce944bb-b2a4-4a42-99c8-2f31c53d12f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:47:59.473014 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-fce944bb-b2a4-4a42-99c8-2f31c53d12f3 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.453588 Aug 31 10:47:59.473547 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Wed Aug 31 10:47:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:48:00.451340 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:48:00.452466 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Aug 31 10:48:00.453032 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:48:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:48:01.008670 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-adf31e22-1ea6-4f9a-a5e3-1e48bf07b1af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:48:01.029483 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-adf31e22-1ea6-4f9a-a5e3-1e48bf07b1af admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.436089 Aug 31 10:48:01.030158 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Wed Aug 31 10:48:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:48:02.008426 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:48:02.009473 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 10:48:02.009889 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:48:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:48:02.573029 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-4f4678fa-aac5-441e-b6e0-be4579d8ff99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:48:02.594850 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-4f4678fa-aac5-441e-b6e0-be4579d8ff99 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.448873 Aug 31 10:48:02.595383 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Wed Aug 31 10:48:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:48:03.582310 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:48:03.583444 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Aug 31 10:48:03.583881 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:48:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:48:04.160442 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-9cc7951f-760d-4c9b-b6b9-d9a568ee3a0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:48:04.181864 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-9cc7951f-760d-4c9b-b6b9-d9a568ee3a0e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.459998 Aug 31 10:48:04.182417 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Wed Aug 31 10:48:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:48:05.154957 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:48:05.156014 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Aug 31 10:48:05.156410 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:48:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:48:05.748298 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-755d3f44-c2a8-4091-afef-f05af441ca4c admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:48:05.768893 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-755d3f44-c2a8-4091-afef-f05af441ca4c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.474988 Aug 31 10:48:05.769441 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Wed Aug 31 10:48:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:48:59.859197 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:48:59.860216 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-fbb74089-ebfe-4536-b2ec-430bb03c8a86 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 31 10:48:59.860620 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 931 bytes} [Wed Aug 31 10:48:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:48:59.871550 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:00.301944 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-52750c42-cb98-490b-897b-4df19c0686cf admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:49:00.323202 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-52750c42-cb98-490b-897b-4df19c0686cf admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.456216 Aug 31 10:49:00.323746 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1292 bytes} [Wed Aug 31 10:48:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:49:00.344242 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG dbcounter [-] [105467] Writing DB stats nova_api:SELECT=14 {{(pid=105467) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:00.348107 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-3829ea4e-cffe-4ee0-b12b-f6884cdccdcf admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:49:00.356119 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-3829ea4e-cffe-4ee0-b12b-f6884cdccdcf admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013241 Aug 31 10:49:00.356639 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1283 bytes} [Wed Aug 31 10:49:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:49:00.368446 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-9444b9c9-aea1-411b-882f-87ff5e1e8aeb admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:49:00.376712 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-9444b9c9-aea1-411b-882f-87ff5e1e8aeb admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011992 Aug 31 10:49:00.377211 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1286 bytes} [Wed Aug 31 10:49:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:49:00.388717 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:49:00.396960 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011670 Aug 31 10:49:00.397407 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1286 bytes} [Wed Aug 31 10:49:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:49:00.409044 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-7af68097-1ff5-4a5d-bab2-090f98e8ff3b admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:49:00.417415 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-7af68097-1ff5-4a5d-bab2-090f98e8ff3b admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011902 Aug 31 10:49:00.418041 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1283 bytes} [Wed Aug 31 10:49:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:52:06.254473 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:52:06.255499 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 31 10:52:06.255932 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 34/69] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:52:06.396810 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:SELECT=6 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:06.570929 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-1cc2b434-6efb-4399-8a79-6ed0e775e4ad admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:52:06.574430 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-1cc2b434-6efb-4399-8a79-6ed0e775e4ad admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:52:06.574910 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-1cc2b434-6efb-4399-8a79-6ed0e775e4ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:52:06.575363 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-1cc2b434-6efb-4399-8a79-6ed0e775e4ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:52:06.576058 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-1cc2b434-6efb-4399-8a79-6ed0e775e4ad admin admin] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:52:06.576506 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-1cc2b434-6efb-4399-8a79-6ed0e775e4ad admin admin] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:52:06.576928 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-1cc2b434-6efb-4399-8a79-6ed0e775e4ad admin admin] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:52:06.612996 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-1cc2b434-6efb-4399-8a79-6ed0e775e4ad admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.217480 Aug 31 10:52:06.613760 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 36/70] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Aug 31 10:52:06 2022] GET /compute/v2.1/os-services => generated 794 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:52:07.460899 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:52:07.461972 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Aug 31 10:52:07.462367 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 35/71] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:52:07.659788 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-8c7a796f-4c26-4b08-91bb-ff52e0e072c0 admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:52:07.663197 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-8c7a796f-4c26-4b08-91bb-ff52e0e072c0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:52:07.663712 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-8c7a796f-4c26-4b08-91bb-ff52e0e072c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:52:07.664140 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-8c7a796f-4c26-4b08-91bb-ff52e0e072c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:52:07.664878 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-8c7a796f-4c26-4b08-91bb-ff52e0e072c0 admin admin] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:52:07.665321 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-8c7a796f-4c26-4b08-91bb-ff52e0e072c0 admin admin] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:52:07.665739 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-8c7a796f-4c26-4b08-91bb-ff52e0e072c0 admin admin] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:52:07.686780 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-8c7a796f-4c26-4b08-91bb-ff52e0e072c0 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.085843 Aug 31 10:52:07.687387 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 37/72] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Aug 31 10:52:07 2022] GET /compute/v2.1/os-services => generated 794 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:52:18.945271 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:52:18.946335 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 31 10:52:18.946738 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 36/73] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:52:19.096473 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell0:SELECT=4 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:19.097886 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_cell1:SELECT=4 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:19.098954 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG dbcounter [-] [105468] Writing DB stats nova_api:SELECT=8 {{(pid=105468) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:19.158552 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-6d66d5bb-98c7-4e29-acad-d5551ae58faa admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:52:19.161959 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-6d66d5bb-98c7-4e29-acad-d5551ae58faa admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:52:19.162437 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-6d66d5bb-98c7-4e29-acad-d5551ae58faa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:52:19.162868 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-6d66d5bb-98c7-4e29-acad-d5551ae58faa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:52:19.163576 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-6d66d5bb-98c7-4e29-acad-d5551ae58faa admin admin] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:52:19.164023 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-6d66d5bb-98c7-4e29-acad-d5551ae58faa admin admin] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:52:19.164440 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-6d66d5bb-98c7-4e29-acad-d5551ae58faa admin admin] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:52:19.189932 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-6d66d5bb-98c7-4e29-acad-d5551ae58faa admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.100858 Aug 31 10:52:19.190452 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 38/74] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Aug 31 10:52:19 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:52:20.016328 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: DEBUG nova.api.openstack.wsgi [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] Calling method '>' {{(pid=105467) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:52:20.017743 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: INFO nova.api.openstack.requestlog [None req-ab54a2d1-a8ad-4881-9c04-9ce511e4267d admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Aug 31 10:52:20.018285 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: [pid: 105467|app: 0|req: 37/75] 10.222.0.75 () {56 vars in 1074 bytes} [Wed Aug 31 10:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:52:20.231206 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG nova.api.openstack.wsgi [None req-a301c8fb-a6d5-4c76-a111-be5b2a73649a admin admin] Calling method '>' {{(pid=105468) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:52:20.236383 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-a301c8fb-a6d5-4c76-a111-be5b2a73649a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:52:20.237005 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-a301c8fb-a6d5-4c76-a111-be5b2a73649a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:52:20.237607 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-a301c8fb-a6d5-4c76-a111-be5b2a73649a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:52:20.238717 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-a301c8fb-a6d5-4c76-a111-be5b2a73649a admin admin] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:52:20.239332 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-a301c8fb-a6d5-4c76-a111-be5b2a73649a admin admin] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:52:20.239898 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: DEBUG oslo_concurrency.lockutils [None req-a301c8fb-a6d5-4c76-a111-be5b2a73649a admin admin] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105468) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:52:20.263161 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: INFO nova.api.openstack.requestlog [None req-a301c8fb-a6d5-4c76-a111-be5b2a73649a admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.098571 Aug 31 10:52:20.263717 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: [pid: 105468|app: 0|req: 39/76] 10.222.0.75 () {60 vars in 1193 bytes} [Wed Aug 31 10:52:20 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:53:21.552392 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: Wed Aug 31 10:53:21 2022 - graceful shutdown triggered... Aug 31 10:53:21.552495 dv-cinder-795785-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 10:53:21.553441 dv-cinder-795785-12-iscsi devstack@n-api.service[105467]: Gracefully killing worker 1 (pid: 105467)... Aug 31 10:53:21.553961 dv-cinder-795785-12-iscsi devstack@n-api.service[105468]: Gracefully killing worker 2 (pid: 105468)... Aug 31 10:53:22.554598 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: worker 1 buried after 1 seconds Aug 31 10:53:22.554598 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: worker 2 buried after 1 seconds Aug 31 10:53:22.554598 dv-cinder-795785-12-iscsi devstack@n-api.service[105466]: goodbye to uWSGI. Aug 31 10:53:22.557860 dv-cinder-795785-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 10:53:22.558760 dv-cinder-795785-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 10:53:22.563247 dv-cinder-795785-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 10:53:22.578851 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 10:53:22.583526 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 10:53:22 2022] *** Aug 31 10:53:22.583789 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 10:53:22.583987 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 10:53:22.584154 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: nodename: dv-cinder-795785-12-iscsi Aug 31 10:53:22.584330 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: machine: x86_64 Aug 31 10:53:22.584638 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: clock source: unix Aug 31 10:53:22.584815 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: pcre jit disabled Aug 31 10:53:22.585055 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: detected number of CPU cores: 4 Aug 31 10:53:22.585282 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: current working directory: / Aug 31 10:53:22.585282 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: detected binary path: /usr/bin/uwsgi-core Aug 31 10:53:22.585282 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: your processes number limit is 47680 Aug 31 10:53:22.585282 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: your memory page size is 4096 bytes Aug 31 10:53:22.585282 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: detected max file descriptor number: 2048 Aug 31 10:53:22.585282 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: lock engine: pthread robust mutexes Aug 31 10:53:22.585810 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: thunder lock: enabled Aug 31 10:53:22.585810 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 10:53:22.585810 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 10:53:22.625045 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: Python main interpreter initialized at 0x5573a871a9c0 Aug 31 10:53:22.625045 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: python threads support enabled Aug 31 10:53:22.625045 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: your server socket listen backlog is limited to 100 connections Aug 31 10:53:22.625045 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: your mercy for graceful operations on workers is 90 seconds Aug 31 10:53:22.625478 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 10:53:22.625478 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: *** Operational MODE: preforking *** Aug 31 10:53:22.628011 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: *** uWSGI is running in multiple interpreter mode *** Aug 31 10:53:22.628011 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: spawned uWSGI master process (pid: 120467) Aug 31 10:53:22.628011 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: spawned uWSGI worker 1 (pid: 120481, cores: 1) Aug 31 10:53:22.628011 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: spawned uWSGI worker 2 (pid: 120482, cores: 1) Aug 31 10:53:22.628011 dv-cinder-795785-12-iscsi devstack@n-api.service[120467]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 10:53:22.626040 dv-cinder-795785-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 10:53:23.290763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 10:53:23.291446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 10:53:24.436148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:53:24.436148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: from cryptography.utils import int_from_bytes Aug 31 10:53:24.436902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:53:24.436902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: from cryptography.utils import int_from_bytes Aug 31 10:53:24.437382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:53:24.437382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: from cryptography.utils import int_from_bytes Aug 31 10:53:24.437914 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:53:24.437914 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: from cryptography.utils import int_from_bytes Aug 31 10:53:26.832998 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:53:26.833667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:53:26.833829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:53:26.834417 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:53:26.834894 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:53:26.835503 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.836024 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.836538 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.837062 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.837738 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.838280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.838811 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.839342 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.839873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.840323 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.840848 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.841384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-12-iscsi {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.841941 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.842449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.842952 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.843478 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.844006 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.844528 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.845038 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.845886 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.846741 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.848042 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.848592 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.849157 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.851190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.851764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.852320 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.852861 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.853412 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.853992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.854629 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-12-iscsi {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.855174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.855708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.856232 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.856866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.857390 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.857947 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.858514 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.859047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.859574 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.860122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.860665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.861204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.861797 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.862329 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.862856 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.863372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.863905 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.864425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.864548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:53:26.864963 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:53:26.865514 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.866090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.866628 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.867177 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.867733 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.867851 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:53:26.868133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:53:26.868393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:53:26.868792 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.868917 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.869248 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.869575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.869815 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.869917 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.870386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.870557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.870841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.871286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.871390 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.871621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.871960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.872224 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.872514 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.872636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.872860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-12-iscsi {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.873188 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.873498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.873758 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.873876 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.874152 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.874503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.874801 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.874916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.875121 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.875615 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.875882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.876383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.876637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.876955 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.877332 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.877435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.877971 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.878089 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.878597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.878701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.879213 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.879402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.879905 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.880136 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.880458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.880804 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.881069 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.881178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.881694 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-12-iscsi {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.882074 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.882173 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.882416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.882732 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.883108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.883220 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.883465 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.883777 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.884101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.884361 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.884470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.884725 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.885103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.885487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.885657 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.886154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.886699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.887268 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.887384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.887914 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.888435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.888911 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.889186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.889550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.889909 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.890239 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.890346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.890712 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.891034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.891257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.891365 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.891771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.892096 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.892197 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.892542 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.892916 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.893079 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.893412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.893672 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.893956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.894251 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.894353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.894598 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.894912 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.895224 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.895536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.895637 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.895842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.896345 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.896825 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.897020 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.897308 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.897701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.898043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.898145 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.898375 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.898704 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.899033 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.899304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.899524 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.899854 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.900234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.900346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.900658 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.901045 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.901156 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.901498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.901889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.902013 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.902331 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.902656 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.902930 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.903115 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.903435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.903746 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.904025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.904136 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.904363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.905132 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.905132 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.905293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.905557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.905915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.906364 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.906665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.907111 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.907229 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.907547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.907862 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.908153 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.908254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.908464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.908777 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.909084 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.909383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.909561 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.909908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.910217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.910508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.910618 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.910970 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.911279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.911520 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.911627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.912110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.912339 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.912454 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.912718 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.913207 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.913320 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.913526 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.913932 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.914275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.914479 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.915034 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.915486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.915773 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.915884 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.916127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.916622 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.917117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.917360 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.917912 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.918015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.918273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.918592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.918915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.919147 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.919252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.919517 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.920000 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.920110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.920319 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.920631 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.920868 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.921091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.921328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.921433 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.921696 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.921826 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.922069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.922191 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.922374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.922564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.922692 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.922969 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.923171 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.923446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.923555 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.923777 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.923880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.924094 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.924205 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.924400 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.924497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.924703 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.924816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.925021 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.925129 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.925352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.925446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.925665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.925889 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.926058 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.926242 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.926552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.926729 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.926862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.927338 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.927467 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.927698 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.927916 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.928021 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.928234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.928338 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.928543 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.928752 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.928934 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.929095 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.929248 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.929393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.929558 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.929710 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.929909 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.930089 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.930245 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.930403 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.930558 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:53:26.930702 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.930856 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.931166 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.931321 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.931476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.931628 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.931783 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.931934 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.932085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.932236 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.932764 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.932933 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.933085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.933237 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.933381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.933539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.933700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.933897 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.934073 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.934229 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.934381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.934533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.934678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.934904 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.935059 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.935341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.935492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.935636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.935796 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.935940 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.936091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.936246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.936391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.936535 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.936696 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.936839 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.936983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.937264 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.937524 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.937684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.937868 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.938019 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.938163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.938307 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.938461 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.938612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.938770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.938915 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.939066 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.939211 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.939379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.939628 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.939792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.939939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.940090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.940247 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.940247 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.940543 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.940695 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.940847 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.940999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.941149 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.941308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.941472 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.941625 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.941990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.942145 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.942300 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.942445 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.942610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.942817 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.942974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.943120 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.943264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.943408 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.943566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.943719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.943719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.944008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.944154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.944544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.944712 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.944868 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.944868 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.946061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.946252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.952200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.952455 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.952616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.952775 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.953037 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.953192 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.953348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.953503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.953655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.953867 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.954019 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.954019 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.954319 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.954466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.954617 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.954769 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.954769 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.955064 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.955209 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.955360 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.955513 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.955841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.956004 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.956332 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.956491 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.956686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.956836 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.957162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.957318 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.957473 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.957635 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.957808 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.957969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.958114 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.958264 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.958447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.958596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.958750 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.958909 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.958909 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.959422 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.959579 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.959732 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.959940 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.960138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.960286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.960440 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.960599 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.960753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.960898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.960898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.960898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.961669 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.961837 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.961837 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.962539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.962694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.962852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.963079 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.963231 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.963395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.963540 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.964217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.964374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.964520 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.964683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.964832 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.964977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.965255 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.965415 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.965569 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.965714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.965905 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.965905 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.966222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.966531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.966682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.966834 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.966978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.967123 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.967274 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.967428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.967579 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.967723 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.967874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.968031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.968031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.968315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.968458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.968600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.968750 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.968903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.969055 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.969200 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.969343 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.969492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.969646 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.969818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.970002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.970161 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.970314 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.970314 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.970630 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.970782 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.970934 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.971086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.971240 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.971386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.971536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.971689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.971840 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.972003 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.972148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.972301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.972570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.972829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.972987 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.973188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.973337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.973488 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.973639 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.973889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.974040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.974187 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.974341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.974487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.974630 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.974788 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.974933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.975083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.975226 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.975379 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.975581 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.975735 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.975879 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.976023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.976165 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.976326 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.976326 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.976734 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.976884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.976884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.977164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.977307 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.977464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.977609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.977609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.977609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.977609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.978192 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.978350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.978495 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.978640 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.978783 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.978937 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.978937 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.979230 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.979382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.979533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.979686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.979828 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.979988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.980283 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.980468 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.980625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.980781 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.980933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.981091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.981235 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.981378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.981527 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.981673 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.981971 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.982135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.982288 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.982454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.982454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.982944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.983096 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.983297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.983454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.983605 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.983757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.983902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.984052 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.984206 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.984351 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.984512 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.984668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.984819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.984973 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.985117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.985259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.985409 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.985553 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.985696 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.985889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.985889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.986176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.986380 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.986539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.986704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.986989 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.987149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.987149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.987439 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.987584 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.987737 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.987890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.988227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.988395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.988549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.989427 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.989620 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.989787 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.989956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.990106 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.990249 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.990393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.990393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.990699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.990845 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.990996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.991208 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.991208 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.991509 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.991671 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.991815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.991974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.992127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.992296 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.993000 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.993247 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.993459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.993614 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.993759 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.994095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.994249 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.994405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.994575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.994721 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.994863 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.995020 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.995171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.995322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.995474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.995618 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.995762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.995927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.996081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.996226 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.996369 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.996529 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.996686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.996845 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.997015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.997269 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.997424 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.997424 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.997719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.997903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.998058 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.998201 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.998353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.998498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.998666 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.998811 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.998955 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.999100 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.999252 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.999405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.999405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.999405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:26.999852 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.000006 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.000279 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.000440 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.000606 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.000759 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.000903 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001047 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001209 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001409 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001566 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001566 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001937 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001937 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001937 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001937 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001937 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.001937 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.002779 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.002939 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.003173 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.003464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.003464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.003755 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.003900 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.004044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.004210 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.004364 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.004509 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.004653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.004808 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.004951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005108 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005558 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005712 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.005898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.006686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.006686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.006992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.006992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.007311 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.007311 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.007704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.007704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.007985 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.008140 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.008285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.008437 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.008437 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.008728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.008873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.009027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.009173 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.009316 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.009460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.009611 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.009782 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.009952 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.010101 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.010252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.010405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.010557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.010721 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.010874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.011018 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.011169 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.011314 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.011458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.011614 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.011614 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.011916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.012069 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.012221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.012376 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.012602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.012602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.012898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.012898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.013205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.013205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.013689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.013914 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.014072 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.014226 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.014372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.014530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.014676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.014832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.014977 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.014977 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.015250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.015404 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.015555 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.015699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.015842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.015986 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.016139 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.016293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.016293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.016582 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.016757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.016908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.017067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.017229 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.017382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.017533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.017812 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.017974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.018130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.018283 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.018429 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.018573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.018723 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.018884 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.019042 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.019207 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.019360 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.019360 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.019642 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.019809 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.019960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.020113 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.020257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.020402 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.020555 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.020708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.020878 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.021030 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.021182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.021327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.021478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.021633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.021877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.022030 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.022186 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.022356 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.022536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.022702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.022857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.023009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.023155 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.023299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.023467 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.023816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.023976 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.024127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.024284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.024610 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.024782 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.024939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.025077 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.025243 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.026111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.026267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.026423 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.026574 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.026703 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.026703 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.026851 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.026930 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027012 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027094 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027255 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027329 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027485 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027561 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027703 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027792 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027880 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.027954 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.028031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.028103 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.028103 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.028238 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.028321 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.028393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.028470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.028549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.028627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.029174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.029340 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.029480 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.029618 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.029780 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.029926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.030075 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.030214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.030374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.030523 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.030659 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.030806 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.030952 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.031091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.031227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.031375 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.031519 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.031692 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.031842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.031979 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032306 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032404 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032490 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032701 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032793 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.032994 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033088 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033088 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033248 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033373 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.033471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034189 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034517 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034707 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034707 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034878 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034970 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.034970 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035134 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035392 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035878 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035963 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.035963 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.036134 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.036222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.036222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.036382 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.036500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.036640 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.036897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.037012 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.037211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.037316 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.037528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.037638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.037920 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.038044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.038282 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.038364 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.038605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.038712 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.038924 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.039024 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.039247 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.039342 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.039605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.039732 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.039880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.040014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.040199 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.040467 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.040573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.040669 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.040820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.040942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.041132 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.041272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.041441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.041590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.041755 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.041964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.042083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.042424 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.042630 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.042716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.042789 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.043026 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.043142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.043330 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.043443 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.043640 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.043746 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.043956 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.044229 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.044328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.044418 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.044561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.044663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.044950 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.045061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.045283 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.045389 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.045595 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.045694 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.045941 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.046093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.046240 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.046371 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.046548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.046681 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.046865 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.047006 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.047172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.047304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.047475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.047606 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.047789 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.047920 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.048126 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.048260 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.048456 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.048597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.048780 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.048914 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.049085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.049218 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.049405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.049537 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.049820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.049992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.050133 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.050270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.050428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.050561 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.050733 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.050882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.051035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.051192 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.051356 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052045 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052444 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052535 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052628 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052714 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052807 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.052954 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.053056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.053355 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.053480 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.053717 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.053874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.054062 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.054206 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.054367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.054469 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.054682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.054776 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.055000 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.055090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.055305 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.055406 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.055617 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.055709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.055926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.056076 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.056249 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.056405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.056570 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.056853 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.056959 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.057175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.057275 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.057848 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.057946 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.058176 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.058290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.058495 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.058622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.058807 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.058908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.059129 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.059258 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.059469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.059578 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.059778 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.059877 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.060087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.060185 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.060411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.060533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.060716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.060817 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.061027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.061120 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.061334 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.061426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.061639 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.061738 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.061968 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.062060 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.062273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.062375 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.062591 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.062684 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.062891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.062990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.063202 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.063308 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.063507 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.063600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.063816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.063916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.064221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.064452 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.064567 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.064664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.064819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.064960 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.065174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.065265 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.065528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.065875 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.066171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.066731 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.066842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.066931 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.067024 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.067182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.067377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.067513 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.067887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.067980 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.068273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.068457 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.068565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.068983 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.069159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.069334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.069655 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.069747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.070199 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.070315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.070908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.071022 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.071110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.071289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.071403 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.071603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.071874 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.071982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.072208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.072486 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.072587 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.072812 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.072992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.073118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.073423 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.073525 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.073747 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.074065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.074171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.074387 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.074478 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.074700 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.074793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.075010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.075104 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.075425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.075515 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.075784 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.075919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.076128 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.076240 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.076431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.076541 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.076748 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.076854 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.077059 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.077159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.077373 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.077489 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.077691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.077805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.078067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.078174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.078350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.078449 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.078664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.078754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.079009 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.079105 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.079374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.079495 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.079723 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.079829 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.080046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.080144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.080397 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.080495 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.080698 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.080803 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.081049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.081225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.081444 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.081658 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.081793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.082121 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.082230 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.082402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.082509 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.082736 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.082949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.083078 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.083273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.083432 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.083653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.083791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.083936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.084096 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.084373 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.084479 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.084738 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.084956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.085104 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.085188 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.085435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.085590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.085757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.086004 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.086149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.086243 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.086498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.086614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.086812 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.086940 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.087135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.087239 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.087461 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.087571 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.087854 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.088041 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.088223 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.088383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.088544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.088704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.088848 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.089054 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.089155 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.089378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.089485 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.089697 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.089819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.090062 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.090384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.090703 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.090795 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.091016 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.091119 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.091341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.091460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.091656 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.091750 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.091971 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.092087 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.092284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.092378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.092597 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.092699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.092913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.093075 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.093234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.093402 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.093572 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.093707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.094667 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.094780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.094872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.094957 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.095032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.095120 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.095207 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.095280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.095431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.095514 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.095754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.095836 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.096075 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.096157 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.096398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.096488 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.096738 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.096825 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.097030 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.097119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.097344 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.097433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.097803 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.098119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.098430 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.098744 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.099054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.099361 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.099683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.099998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.100303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.100738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.101055 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.101894 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.102078 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.102241 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.102392 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.102548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.102729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.102932 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.103089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.103235 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.103412 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.103576 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.103771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.103930 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.104085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.104246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.104402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.105212 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.105362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.105519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.105676 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.105855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.106029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.106029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.106328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.106474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.106622 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.106766 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.106954 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.107112 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.107257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.107401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.107558 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.107710 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.107870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.108014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.108014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.108312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.108462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.108621 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.108767 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.108911 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.109064 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.109210 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.109362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.109362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.109672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.109850 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.110002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.110146 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.110291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.110449 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.110601 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.110762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.110762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.111086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.111233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.111390 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.111554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.111554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.111829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.111973 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.112136 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.112289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.112488 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.112811 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.113114 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.113265 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.113419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.113573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.113728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.113964 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.114111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.114286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.114445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.114618 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.114768 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.114940 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.115124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.115280 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.115433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.115680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.115830 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.116070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.116293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.116459 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.116636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.116803 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.116953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.117100 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.117285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.117448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.117593 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.117735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.117936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.118098 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.118263 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.118421 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.118574 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.118735 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.118887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.119032 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.119185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.119340 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.119485 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.119763 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.119914 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.120065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.120223 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.120396 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.120541 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.120685 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.120879 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.121038 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.121195 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.121340 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.121484 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.121627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.121798 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.121949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.122157 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.122331 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.122491 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.122642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.122792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.122953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.123105 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.123292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.123447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.123598 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.123757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.123922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.124074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.124225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.124394 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.124562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.124729 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.124890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.125050 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.125203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.125353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.125506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.125705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.125911 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.126065 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.126233 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.126385 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.126548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.126800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.126966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.127118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.127281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.127434 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.127586 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.127751 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.127911 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.128063 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.128214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.128366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.128529 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.128693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.128846 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.129084 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.129243 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.129426 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.129593 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.129754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.129935 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.130096 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.130255 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.130409 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.130579 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.130732 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.130954 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.131128 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.131315 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.131470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.131635 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.131824 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.131978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.132137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.132296 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.132457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.132610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.132771 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.132922 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.133082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.133242 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.133406 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.133558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.133709 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.133925 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.134077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.134229 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.134391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.134544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.134702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.134873 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.135026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.135192 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.135933 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.136097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.136251 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.136402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.136563 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.136724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.136885 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.137049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.137202 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.137366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.137526 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.137688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.137913 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.138067 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.138231 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.138391 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.138543 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.138709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.138870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.139031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.139031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.139327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.139536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.139703 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.139855 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.140007 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.140168 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.140330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.140490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.140490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.140788 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.140948 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.141112 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.141264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.141427 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.141592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.141745 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.141961 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.142115 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.142276 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.142276 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.142575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.142728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.142887 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.143039 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.143200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.143353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.143353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.143666 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.143826 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.143978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.144137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.144298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.144457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.144610 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.144768 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.144928 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.145101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.145267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.145430 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.145615 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.145907 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.145907 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.146578 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.146736 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.146897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.147053 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.147213 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.147449 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.147575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.147826 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.148041 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.148214 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.148368 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.148536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.148536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.148864 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.149015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.149166 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.149328 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.149483 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.149634 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.149803 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.149961 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.150124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.150288 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.150288 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.150590 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.150750 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.150910 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.151063 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.151223 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.151375 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.151533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.151693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.151854 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.152006 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.152175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.152335 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.152487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.152638 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.152638 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.152942 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.153094 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.153245 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.153245 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.153547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.153547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.153871 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.154037 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.154189 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.154339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.154498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.154663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.154830 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.154982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.155133 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.155283 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.155435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.155585 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.155757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.155918 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.156090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.156241 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:53:27.156393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.156393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.156393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.157266 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.157616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.158093 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.158500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.158791 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.159134 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.159540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.159937 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.160215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.160541 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.160850 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.161160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.161575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.161957 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.162287 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.162578 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.162996 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.163275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.163576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.163899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.164215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.164530 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.164844 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.165267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.165605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.165977 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.166291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.166602 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.166909 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.167217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.167528 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.167835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.168143 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.168455 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.168765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.169086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.169454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.169735 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.170132 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.170460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.170806 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.171115 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.171486 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.171810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.172118 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.172425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.172725 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:53:27.172966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:53:27.217061 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO dbcounter [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Registered counter for database nova_api Aug 31 10:53:27.233882 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO dbcounter [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Registered counter for database nova_api Aug 31 10:53:27.239741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_db.sqlalchemy.engines [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:53:27.247073 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writer thread running {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:53:27.254794 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_db.sqlalchemy.engines [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:53:27.261761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writer thread running {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:53:27.303162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.context [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05e8ed1e-1228-4051-ab88-71c736654b3f(cell1) {{(pid=120482) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 10:53:27.307288 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:53:27.308116 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:53:27.309886 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:53:27.310466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:53:27.310911 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:53:27.312924 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:53:27.315050 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO dbcounter [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Registered counter for database nova_cell0 Aug 31 10:53:27.317687 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.context [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),05e8ed1e-1228-4051-ab88-71c736654b3f(cell1) {{(pid=120481) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 10:53:27.319272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO dbcounter [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Registered counter for database nova_cell1 Aug 31 10:53:27.321919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:53:27.322519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:53:27.324555 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:53:27.324858 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:53:27.325300 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:53:27.327390 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:53:27.327681 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_db.sqlalchemy.engines [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:53:27.328733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_db.sqlalchemy.engines [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:53:27.329934 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO dbcounter [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Registered counter for database nova_cell0 Aug 31 10:53:27.334167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO dbcounter [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Registered counter for database nova_cell1 Aug 31 10:53:27.336337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writer thread running {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:53:27.337742 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writer thread running {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:53:27.341404 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_db.sqlalchemy.engines [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:53:27.343848 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_db.sqlalchemy.engines [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:53:27.348872 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writer thread running {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:53:27.354274 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writer thread running {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:53:27.485598 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO dbcounter [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Registered counter for database nova_cell0 Aug 31 10:53:27.492869 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_db.sqlalchemy.engines [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:53:27.497166 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO dbcounter [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Registered counter for database nova_cell0 Aug 31 10:53:27.498313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writer thread running {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:53:27.504174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_db.sqlalchemy.engines [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:53:27.509891 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writer thread running {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:53:27.817945 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: WARNING keystonemiddleware.auth_token [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:53:27.825384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: WARNING keystonemiddleware.auth_token [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:53:27.825945 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: WARNING keystonemiddleware.auth_token [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:53:27.833379 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: WARNING keystonemiddleware.auth_token [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:53:28.181960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: WARNING keystonemiddleware.auth_token [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:53:28.182836 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: WARNING keystonemiddleware.auth_token [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 10:53:28.188366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: WARNING keystonemiddleware.auth_token [None req-39791724-f18b-445c-8785-b649fd786cd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:53:28.188537 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: WARNING keystonemiddleware.auth_token [None req-1b2f25e5-36c7-4fc3-9ac6-177959ba5ff8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 10:53:28.193744 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573a871a9c0 pid: 120481 (default app) Aug 31 10:53:28.194491 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5573a871a9c0 pid: 120482 (default app) Aug 31 10:54:05.023688 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=3 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:05.024508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=3 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:05.025535 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=3 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:05.027245 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=3 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:05.893432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-eb93e592-662c-4324-bcbc-44ddda6492ae tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Action: 'create', calling method: .version_select at 0x7f37a9c87e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-339519854", "metadata": {"Type": "work"}}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:06.198927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8d2176e7-2fac-4b0c-b968-6daae295ee7a tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9d659d0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:06.198927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:06.198927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:06.198927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:06.198927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:06.991658 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8d2176e7-2fac-4b0c-b968-6daae295ee7a tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/c8040c21-80d3-451a-85c3-b602f604076d" status: 200 len: 351 microversion: 2.1 time: 1.256321 Aug 31 10:54:06.992586 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 1/1] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:05 2022] GET /compute/v2.1/os-volumes/c8040c21-80d3-451a-85c3-b602f604076d => generated 351 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:07.492741 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-eb93e592-662c-4324-bcbc-44ddda6492ae tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.481759 Aug 31 10:54:07.494092 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 1/2] 10.222.0.75 () {60 vars in 1156 bytes} [Wed Aug 31 10:54:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2485 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 10:54:07.510582 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4050e200-6c46-4a3d-943e-3d2306c2a2b4 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b3dca0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:07.751807 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4050e200-6c46-4a3d-943e-3d2306c2a2b4 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 353 microversion: 2.1 time: 0.245350 Aug 31 10:54:07.752416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:07 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:07.768456 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6c4c914a-73d1-4d10-b42d-4ce9fd3d89ea tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b08ca0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:08.148983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6c4c914a-73d1-4d10-b42d-4ce9fd3d89ea tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 353 microversion: 2.1 time: 0.386967 Aug 31 10:54:08.149557 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:07 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 353 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:08.180145 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9105bb50-1dde-4238-b1ea-094341bcf3c8 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b3db80>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:08.268867 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9105bb50-1dde-4238-b1ea-094341bcf3c8 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 202 len: 0 microversion: 2.1 time: 0.099006 Aug 31 10:54:08.269448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 3/5] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 10:54:08 2022] DELETE /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:54:08.278836 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-70302c46-5b52-49da-8349-1133f0ed109b tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b223a0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:08.392030 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-70302c46-5b52-49da-8349-1133f0ed109b tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 352 microversion: 2.1 time: 0.116717 Aug 31 10:54:08.392941 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 3/6] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:08 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:08.725998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-03d81898-7ba8-4571-8f80-7a4c9421076c tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9b03550>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:08.843530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-03d81898-7ba8-4571-8f80-7a4c9421076c tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/f6caf784-10e6-40c4-98dc-cb51b2bde202" status: 200 len: 351 microversion: 2.1 time: 0.121733 Aug 31 10:54:08.844536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:08 2022] GET /compute/v2.1/os-volumes/f6caf784-10e6-40c4-98dc-cb51b2bde202 => generated 351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:09.408512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-addf3a0c-f6f5-4046-8963-9fcfc1ce7643 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b22a60>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:09.546370 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-addf3a0c-f6f5-4046-8963-9fcfc1ce7643 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 352 microversion: 2.1 time: 0.144531 Aug 31 10:54:09.547087 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:09 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:10.562120 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-218a37a9-3766-4bcc-9047-b0deaea343c1 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b03b80>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:10.667113 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-218a37a9-3766-4bcc-9047-b0deaea343c1 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 352 microversion: 2.1 time: 0.110735 Aug 31 10:54:10.667967 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 5/9] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:10 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:11.680731 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9c3cb15d-290b-49f0-a1b7-83b9d7b92824 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b08ca0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:11.761450 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9c3cb15d-290b-49f0-a1b7-83b9d7b92824 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 352 microversion: 2.1 time: 0.084683 Aug 31 10:54:11.762308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 5/10] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:11 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:12.778449 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c95e2d8a-74c5-4e5b-809d-78eb5c79fde6 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b03d30>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:12.896344 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c95e2d8a-74c5-4e5b-809d-78eb5c79fde6 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 352 microversion: 2.1 time: 0.124794 Aug 31 10:54:12.902401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 6/11] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:12 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:13.910685 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ba5ffd3f-2a5c-4bad-b497-2b32812c7a91 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b22af0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:14.018583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ba5ffd3f-2a5c-4bad-b497-2b32812c7a91 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 352 microversion: 2.1 time: 0.110936 Aug 31 10:54:14.019709 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 6/12] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:13 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:15.033466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-95be4e65-56c9-4def-b975-1d5acde6fefb tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9b03550>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:15.159119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-95be4e65-56c9-4def-b975-1d5acde6fefb tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 352 microversion: 2.1 time: 0.131299 Aug 31 10:54:15.159827 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 7/13] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:15 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:15.571275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1797437932", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "networks": [{"uuid": "2ff21e66-732b-41b9-b22c-a15f0c74d0a9"}]}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:15.801953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.network.neutron [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] validate_networks() for [('2ff21e66-732b-41b9-b22c-a15f0c74d0a9', None, None, None, None, None)] {{(pid=120481) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:54:16.128352 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-51f56b4e-5862-4690-8064-b0939a6b802b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'create', calling method: .version_select at 0x7f37a9b3da60>, body: {"keypair": {"name": "tempest-keypair-1731906644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPIV+6ppxLouUAzAaufrBG0VUuySliLQ/qlJ//LDqAbsGGhNU0CdoyV0izldS2WwrP8fn2fN0l8Ul73d/9mFFK1blnBl1fl2YPHigv+UCIDrhqfLW6ml/l+EeRIgS7b9Q=="}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:16.222539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-51f56b4e-5862-4690-8064-b0939a6b802b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Getting quotas for project dd581788f9ca4c2fb1ba3fe02f34b29d. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:54:16.232828 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-51f56b4e-5862-4690-8064-b0939a6b802b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Getting quotas for user cbb16c0b86444a59ab299013c694cb07 and project dd581788f9ca4c2fb1ba3fe02f34b29d. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:54:16.334587 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-51f56b4e-5862-4690-8064-b0939a6b802b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.313823 Aug 31 10:54:16.335217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 8/14] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 10:54:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:54:16.351207 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-527bf63e-f2a5-4b25-b282-956969cffd21 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9a725e0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:16.506005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-527bf63e-f2a5-4b25-b282-956969cffd21 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/846a2f3b-c96c-4340-a442-113bb46168be" status: 200 len: 351 microversion: 2.1 time: 0.169341 Aug 31 10:54:16.506825 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 9/15] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:16 2022] GET /compute/v2.1/os-volumes/846a2f3b-c96c-4340-a442-113bb46168be => generated 351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:16.518456 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e99a349f-c52f-4a09-a2e4-ccb4388ebc03 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9a29310>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:16.669086 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e99a349f-c52f-4a09-a2e4-ccb4388ebc03 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 352 microversion: 2.1 time: 0.160022 Aug 31 10:54:16.679826 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 10/16] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:16 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:16.690545 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-75d9fddd-aa20-4f41-bcb5-53ee40517490 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9a299d0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:16.943563 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-75d9fddd-aa20-4f41-bcb5-53ee40517490 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.262413 Aug 31 10:54:16.944871 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 11/17] 10.222.0.75 () {58 vars in 1134 bytes} [Wed Aug 31 10:54:16 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:16.963798 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-681f99fd-b9c7-4532-b01a-efc48afde62e tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9a29d30>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:17.178755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-681f99fd-b9c7-4532-b01a-efc48afde62e tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.224112 Aug 31 10:54:17.179419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 12/18] 10.222.0.75 () {58 vars in 1149 bytes} [Wed Aug 31 10:54:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:54:17.193504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c76212b9-6fb1-4d41-9fc6-4ba76db849f6 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9a72430>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:17.432935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c76212b9-6fb1-4d41-9fc6-4ba76db849f6 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.243375 Aug 31 10:54:17.434290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 13/19] 10.222.0.75 () {58 vars in 1134 bytes} [Wed Aug 31 10:54:17 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:17.448764 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9f5519cb-6c45-4873-94c2-4a553e0fd949 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9a723a0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:17.622805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9f5519cb-6c45-4873-94c2-4a553e0fd949 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.179562 Aug 31 10:54:17.623378 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 14/20] 10.222.0.75 () {58 vars in 1167 bytes} [Wed Aug 31 10:54:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:17.641506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-24c24186-51b9-414f-8050-c8f12c10059d tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9a29ca0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:17.785981 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-24c24186-51b9-414f-8050-c8f12c10059d tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.150121 Aug 31 10:54:17.786581 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 15/21] 10.222.0.75 () {58 vars in 1170 bytes} [Wed Aug 31 10:54:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:17.795097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8580fc1d-a259-49a7-9d84-e7264c6fa445 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9a34f70>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:17.966942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8580fc1d-a259-49a7-9d84-e7264c6fa445 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 200 len: 352 microversion: 2.1 time: 0.175457 Aug 31 10:54:17.968028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 16/22] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:17 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 352 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:17.978160 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-91bca4dc-2211-4aae-9eb4-336f6fa6fee1 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9a343a0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:18.096642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Flavor limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:54:18.097689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Image limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:54:18.100895 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Flavor pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:54:18.101578 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Image pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:54:18.102186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:54:18.169928 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:18.170733 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:18.172183 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:18.174453 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:18.176116 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:18.177423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:18.244944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-91bca4dc-2211-4aae-9eb4-336f6fa6fee1 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.275527 Aug 31 10:54:18.245673 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 17/23] 10.222.0.75 () {58 vars in 1155 bytes} [Wed Aug 31 10:54:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:18.259664 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c197363a-caa7-40ea-ab7d-ea78095d47d3 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9a29310>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:18.260505 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Getting quotas for project 1aa7cb99f3b44a85b984b80ad08e17c5. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:54:18.272174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Getting quotas for user c31a0c08c7a249caadd609a3e772c1c2 and project 1aa7cb99f3b44a85b984b80ad08e17c5. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:54:18.289055 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Going to run 1 instances... {{(pid=120481) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:54:18.292645 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120481) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:54:18.517444 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-dccf4174-562e-4321-9133-3d4996f641b8 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.038406 Aug 31 10:54:18.519162 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 7/24] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:54:18.535778 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ed8fa0da-3212-4bfe-97c9-6852ce9bd2db tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:18.541381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ed8fa0da-3212-4bfe-97c9-6852ce9bd2db tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:18.556223 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c197363a-caa7-40ea-ab7d-ea78095d47d3 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.300837 Aug 31 10:54:18.557660 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 18/25] 10.222.0.75 () {58 vars in 1188 bytes} [Wed Aug 31 10:54:18 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:18.572341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cb278a25-daf1-4186-8b70-a0ac22076795 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] Calling method '.version_select at 0x7f37a9a72d30>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:18.815156 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cb278a25-daf1-4186-8b70-a0ac22076795 tempest-VolumesTestJSON-533212837 tempest-VolumesTestJSON-533212837-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.246145 Aug 31 10:54:18.815499 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 19/26] 10.222.0.75 () {58 vars in 1155 bytes} [Wed Aug 31 10:54:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:18.981933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-95d6639b-740f-4f7d-abf4-f77bc1006741 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Calling method '.version_select at 0x7f37a9a29280>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:18.993269 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ed8fa0da-3212-4bfe-97c9-6852ce9bd2db tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:19.029743 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ed8fa0da-3212-4bfe-97c9-6852ce9bd2db tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1215 microversion: 2.1 time: 0.501682 Aug 31 10:54:19.031419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 8/27] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:18 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1215 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:19.069529 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-95d6639b-740f-4f7d-abf4-f77bc1006741 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] HTTP exception thrown: Volume 6b1bcef1-090a-44ac-8724-99c854704987 could not be found. Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-95d6639b-740f-4f7d-abf4-f77bc1006741 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Request method failure captured: Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 HTTP/1.1 Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3MlSlvLtzFNgisRsf9B6Y5c14zKoIBD2xPMRpTDxpTM72lGJe_cNY2JUZkD9LfiUY4v_6uZixMbGLa8Mv_pUQSydGKRA2GA9QTWnMC8Bv59zPXq0HtVzHsVYyvMSSTPUFecUp3qeZdOuxvCMM2o6mvlWYPOxiBDaOlQR5RAkUX67M Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 65db563016794cacbf33fa984d7f80db Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-VolumesGetTestJSON-579701616 Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:54:19.073810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_65db563016794cacbf33fa984d7f80db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/65db563016794cacbf33fa984d7f80db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/65db563016794cacbf33fa984d7f80db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/65db563016794cacbf33fa984d7f80db"}]}] Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-VolumesGetTestJSON-579701616 Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 65db563016794cacbf33fa984d7f80db Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-VolumesGetTestJSON-579701616 Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-VolumesGetTestJSON-579701616-project Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 5510f78afb8249a2b9d9a89645135345 Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-VolumesGetTestJSON-579701616-project Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Volume 6b1bcef1-090a-44ac-8724-99c854704987 could not be found. Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '6b1bcef1-090a-44ac-8724-99c854704987'} Aug 31 10:54:19.074913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b1bcef1-090a-44ac-8724-99c854704987 could not be found. (HTTP 404) (Request-ID: req-e1c86965-14d5-4ef4-a75c-5033fdcf9600) Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:54:19.075570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 10:54:19.076486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b1bcef1-090a-44ac-8724-99c854704987 could not be found. Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 10:54:19.077370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b1bcef1-090a-44ac-8724-99c854704987 could not be found. Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b1bcef1-090a-44ac-8724-99c854704987 could not be found. Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-95d6639b-740f-4f7d-abf4-f77bc1006741 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] Returning 404 to user: Volume 6b1bcef1-090a-44ac-8724-99c854704987 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-95d6639b-740f-4f7d-abf4-f77bc1006741 tempest-VolumesGetTestJSON-579701616 tempest-VolumesGetTestJSON-579701616-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987" status: 404 len: 109 microversion: 2.1 time: 0.098755 Aug 31 10:54:19.080040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 20/28] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 10:54:18 2022] GET /compute/v2.1/os-volumes/6b1bcef1-090a-44ac-8724-99c854704987 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:54:19.560754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-924419665", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:19.707260 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.network.neutron [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] validate_networks() for [('ae23e21a-87d5-483e-aa49-0c7be5f1867f', None, None, None, None, None)] {{(pid=120481) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:54:20.054066 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b0e8d75a-e180-4c7e-8379-1f8793bf9c60 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:20.055656 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b0e8d75a-e180-4c7e-8379-1f8793bf9c60 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:20.373381 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b0e8d75a-e180-4c7e-8379-1f8793bf9c60 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:20.431749 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b0e8d75a-e180-4c7e-8379-1f8793bf9c60 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1215 microversion: 2.1 time: 0.382037 Aug 31 10:54:20.436864 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 21/29] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:20 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1215 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:20.474277 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Flavor limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:54:20.474784 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Image limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:54:20.475577 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Flavor pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:54:20.476165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Image pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:54:20.476934 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:54:20.491865 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:20.493423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:20.494256 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:20.495333 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:20.496151 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:20.496907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:20.524695 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Getting quotas for project 3aabb02cf14541f997b08fe0853acac0. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:54:20.531479 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Getting quotas for user 3dc4ac4ada004bbb942c36755f4a7cd1 and project 3aabb02cf14541f997b08fe0853acac0. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:54:20.561060 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Going to run 1 instances... {{(pid=120481) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:54:20.564856 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120481) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:54:20.672195 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fbda37e6-6271-4f03-ac32-c4746db00093 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.240105 Aug 31 10:54:20.680863 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 9/30] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:54:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:54:20.689169 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5fbe1b49-2ea4-4c5f-bfc1-77193d87bc31 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:20.689903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5fbe1b49-2ea4-4c5f-bfc1-77193d87bc31 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:20.832147 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5fbe1b49-2ea4-4c5f-bfc1-77193d87bc31 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:20.863811 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5fbe1b49-2ea4-4c5f-bfc1-77193d87bc31 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1221 microversion: 2.1 time: 0.181963 Aug 31 10:54:20.905825 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 22/31] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:20 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1221 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:21.284905 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1040303234", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:21.386963 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.network.neutron [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] validate_networks() for [('ae23e21a-87d5-483e-aa49-0c7be5f1867f', None, None, None, None, None)] {{(pid=120481) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:54:21.459057 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:21.460744 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:21.477877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:21.481408 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:21.481408 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:21.483990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:21.484817 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:21.486928 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:22.097694 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:22.132560 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-afcf33be-f0fe-4e42-88b5-b14d59684562 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1211 microversion: 2.1 time: 0.679190 Aug 31 10:54:22.151784 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 23/32] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:21 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1211 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:22.369846 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-212b0120-1f6c-4c0e-9ec1-68fd4339db3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: .version_select at 0x7f37a995e1f0>, body: {"keypair": {"name": "tempest-keypair-1273694664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEG44J3xa8avLpURoFX6HDx8kK6d+zkMGnxU1Dbm2/OAIvNJVmrsBAaUqvAs4HA6qR41vpy8RWn5dvCu4hAf46JQlgtIupi0TsNnXtAIKZCOtiGnZDt/SbLBJJgllajCUQ=="}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:22.430718 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-212b0120-1f6c-4c0e-9ec1-68fd4339db3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:54:22.446998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-212b0120-1f6c-4c0e-9ec1-68fd4339db3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for user 73f1b9e32ad3493284c5df45afd042fa and project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:54:22.511602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-212b0120-1f6c-4c0e-9ec1-68fd4339db3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.358186 Aug 31 10:54:22.512572 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 24/33] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 10:54:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:22.669823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Flavor limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:54:22.670454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Image limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:54:22.670913 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Flavor pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:54:22.671510 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Image pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:54:22.671935 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:54:22.684962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:22.685460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:22.685929 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:22.686942 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:22.687990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:22.688435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:22.711683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Getting quotas for project 3aabb02cf14541f997b08fe0853acac0. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:54:22.716732 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Getting quotas for user 3dc4ac4ada004bbb942c36755f4a7cd1 and project 3aabb02cf14541f997b08fe0853acac0. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:54:22.731704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Going to run 1 instances... {{(pid=120481) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:54:22.734582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120481) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:54:22.859678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9f7b6cf0-9442-4bd2-84e0-ec2ca8f39931 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.578875 Aug 31 10:54:22.861073 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 10/34] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:54:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:54:22.871458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5d7b2d52-1ab1-48be-b50f-40c5eeba1059 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:22.872084 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5d7b2d52-1ab1-48be-b50f-40c5eeba1059 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:22.988394 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5d7b2d52-1ab1-48be-b50f-40c5eeba1059 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:23.008203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5d7b2d52-1ab1-48be-b50f-40c5eeba1059 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1222 microversion: 2.1 time: 0.138412 Aug 31 10:54:23.010865 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 25/35] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:22 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:23.155569 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:23.156333 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:23.169170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:23.169662 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:23.170134 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:23.170831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:23.171277 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:23.171692 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:23.653428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:23.705016 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-70121238-4c7e-4752-b301-91e31d8f4c6f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1211 microversion: 2.1 time: 0.551276 Aug 31 10:54:23.709146 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 11/36] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:23 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1211 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:23.862154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1700037529", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bef1d45c-b826-4be6-8c9e-24871b00faaa"}], "security_groups": [{"name": "tempest-securitygroup--1555583969"}], "key_name": "tempest-keypair-1731906644", "user_data": "}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:24.036453 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:24.037246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:24.061461 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:24.062604 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:24.065262 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:24.070139 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:24.072902 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:24.077327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:24.254214 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] validate_networks() for [('bef1d45c-b826-4be6-8c9e-24871b00faaa', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:54:24.539500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:24.572337 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1a1ae7fd-c250-49b2-bd09-c6aad6014b84 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1218 microversion: 2.1 time: 0.542217 Aug 31 10:54:24.600598 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 12/37] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:24 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1218 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:24.729310 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:24.729962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:24.745339 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:24.746238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:24.749298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:24.752375 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:24.755985 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:24.758635 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:24.902533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:24.915500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c821d350-54cf-427d-8731-6e04b06495b1 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1267 microversion: 2.1 time: 0.188253 Aug 31 10:54:24.916536 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 13/38] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:24 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:25.599622 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:25.600391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:25.613390 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:25.614171 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:25.614765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:25.615717 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:25.617761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:25.618675 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:26.674239 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:26.689053 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-35b3ef70-9ad6-4d03-9406-8ba7774bc345 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1282 microversion: 2.1 time: 1.093718 Aug 31 10:54:26.716254 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 14/39] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:25 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1282 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:26.730811 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:26.731563 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:26.762280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:26.768327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:26.770392 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:26.774760 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:26.776562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:26.777153 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:27.048711 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:27.064274 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fd6aeec9-f786-4f66-88dd-13dcff24e29f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1273 microversion: 2.1 time: 0.346866 Aug 31 10:54:27.070606 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 15/40] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:26 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1273 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:27.711437 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:27.712181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:27.720076 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:27.727799 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:27.728671 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:27.730968 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:27.733227 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:27.735284 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:28.324891 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:28.336974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-022e24b9-a63e-44a6-bb58-5baebcb5b1d6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1280 microversion: 2.1 time: 0.629437 Aug 31 10:54:28.361598 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 16/41] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:27 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1280 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:28.384014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:28.384644 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:28.403919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:28.404419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:28.404862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:28.405574 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:28.406045 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:28.406471 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:28.743084 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:28.754602 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-91879bfb-6bf0-4578-a7e3-173832f86eb0 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1273 microversion: 2.1 time: 0.379687 Aug 31 10:54:28.759694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 17/42] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:28 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:29.169809 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1749710516", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea0de259-9ec9-40ad-9450-e7dd0067411a"}], "security_groups": [{"name": "tempest-securitygroup--1714598003"}], "key_name": "tempest-keypair-1273694664", "user_data": "}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:29.256623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:54:29.257753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:54:29.258603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:54:29.259165 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:54:29.259779 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:54:29.281513 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:29.290473 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:29.292636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:29.293604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:29.295623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:29.297584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:29.377724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Getting quotas for project dd581788f9ca4c2fb1ba3fe02f34b29d. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:54:29.384832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Getting quotas for user cbb16c0b86444a59ab299013c694cb07 and project dd581788f9ca4c2fb1ba3fe02f34b29d. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:54:29.412217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:54:29.418489 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:54:29.583961 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-eb59711b-409f-4d2f-ab1c-2209cda89c5b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.726674 Aug 31 10:54:29.589563 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 26/43] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:54:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 5733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:54:29.599998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:29.606124 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:29.625062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:29.625062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:29.629609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:29.632056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:29.635338 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:29.635802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:30.144139 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.network.neutron [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] validate_networks() for [('ea0de259-9ec9-40ad-9450-e7dd0067411a', None, None, None, None, None)] {{(pid=120481) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:54:30.609829 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:30.621062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ef45b00b-39d8-4c60-bc28-7b2a40f35353 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1280 microversion: 2.1 time: 1.029303 Aug 31 10:54:30.624250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 27/44] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:29 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1280 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:30.638000 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7633d1fd-7e02-4922-a3c2-ed6e3bf43d44 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:30.641392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7633d1fd-7e02-4922-a3c2-ed6e3bf43d44 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:31.051643 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7633d1fd-7e02-4922-a3c2-ed6e3bf43d44 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:31.074165 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7633d1fd-7e02-4922-a3c2-ed6e3bf43d44 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1238 microversion: 2.1 time: 0.447843 Aug 31 10:54:31.074774 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 28/45] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:30 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1238 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:31.097584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:31.099621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:31.114503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:31.117027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:31.117542 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:31.121460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:31.122015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:31.122462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:32.702998 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=6 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:32.728009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=20 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:33.368641 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:33.376962 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ea25e2e2-4cbd-40cf-97f2-9233aeb973b2 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 2.299302 Aug 31 10:54:33.402486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 29/46] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:31 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 2327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:33.413816 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:33.416472 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:33.433617 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:33.434572 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:33.435254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:33.436138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:33.443052 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:33.443984 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:34.628944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:34.630160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Flavor limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:54:34.634675 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Image limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:54:34.635613 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Flavor pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:54:34.636231 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Image pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:54:34.636917 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:54:34.654261 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0dbf8cf9-3d32-4ba9-8902-18f78b6aaa9e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 1.245204 Aug 31 10:54:34.666733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 30/47] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:33 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:34.690904 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:34.696017 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:34.696663 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:34.697522 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:34.700837 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:34.704939 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:34.706241 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:34.711761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:34.734800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:34.736890 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:34.746298 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:34.754806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:34.755498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:34.758317 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:34.813999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:54:34.835888 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for user 73f1b9e32ad3493284c5df45afd042fa and project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:54:34.902891 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Going to run 1 instances... {{(pid=120481) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:54:34.907092 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120481) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:54:35.068054 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ed93d73a-ab86-4348-91ea-b8bcde0d9bd0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.904507 Aug 31 10:54:35.068790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 18/48] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:54:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 5906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:54:35.073893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:35.086207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:35.102288 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:35.103041 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:35.103639 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:35.110699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:35.111357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:35.112255 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:35.305691 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:35.320234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e4e4d009-e06e-4b04-bf59-37c92229f18e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1296 microversion: 2.1 time: 0.645604 Aug 31 10:54:35.324087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 31/49] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:34 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1296 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:35.341761 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-30d82214-91c6-4e20-b8cd-75c978d060e8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:35.342491 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-30d82214-91c6-4e20-b8cd-75c978d060e8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:35.749630 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-30d82214-91c6-4e20-b8cd-75c978d060e8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:35.768814 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-30d82214-91c6-4e20-b8cd-75c978d060e8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1242 microversion: 2.1 time: 0.441925 Aug 31 10:54:35.769494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 32/50] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:35 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1242 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:35.790393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:35.796329 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:35.829682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:35.830500 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:35.831113 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:35.833291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:35.833942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:35.834611 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:36.175866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:36.198957 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f1d602a4-39eb-4224-8ac8-6c3a92594253 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 1.121354 Aug 31 10:54:36.202798 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 19/51] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:35 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:36.381557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:36.392583 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-39516211-b6f3-4286-9fd6-5610b321d49a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.618955 Aug 31 10:54:36.394079 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 33/52] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:35 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:36.401279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:36.418863 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:36.441830 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=5 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:36.446842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:36.449735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:36.450296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:36.451777 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:36.452515 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:36.453472 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:36.476139 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-40a8716e-48e9-4dcb-8cbd-22c2020dadbd req-e6b56a6d-0c6e-4fca-90b3-b6dc4faebc38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c872949e-187f-4c56-a92e-46a8f341f1f8", "tag": "400efad8-4a73-4f8f-9ed3-32e061d542a8"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:36.511163 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-40a8716e-48e9-4dcb-8cbd-22c2020dadbd req-e6b56a6d-0c6e-4fca-90b3-b6dc4faebc38 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:36.512884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-40a8716e-48e9-4dcb-8cbd-22c2020dadbd req-e6b56a6d-0c6e-4fca-90b3-b6dc4faebc38 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:36.521690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-40a8716e-48e9-4dcb-8cbd-22c2020dadbd req-e6b56a6d-0c6e-4fca-90b3-b6dc4faebc38 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:36.592876 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-40a8716e-48e9-4dcb-8cbd-22c2020dadbd req-e6b56a6d-0c6e-4fca-90b3-b6dc4faebc38 service nova] Creating event network-changed:400efad8-4a73-4f8f-9ed3-32e061d542a8 for instance c872949e-187f-4c56-a92e-46a8f341f1f8 on hv-cinder-79578 Aug 31 10:54:36.593409 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-40a8716e-48e9-4dcb-8cbd-22c2020dadbd req-e6b56a6d-0c6e-4fca-90b3-b6dc4faebc38 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120481) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 10:54:36.593879 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-40a8716e-48e9-4dcb-8cbd-22c2020dadbd req-e6b56a6d-0c6e-4fca-90b3-b6dc4faebc38 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120481) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 10:54:36.595310 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-975c5784-45c1-4601-82f3-d665b0972a63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:36.595884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-975c5784-45c1-4601-82f3-d665b0972a63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:36.596778 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-975c5784-45c1-4601-82f3-d665b0972a63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:36.600531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-975c5784-45c1-4601-82f3-d665b0972a63 None None] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:36.602001 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-975c5784-45c1-4601-82f3-d665b0972a63 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:36.602695 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-975c5784-45c1-4601-82f3-d665b0972a63 None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:36.615664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.compute.rpcapi [None req-975c5784-45c1-4601-82f3-d665b0972a63 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 10:54:36.617337 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-975c5784-45c1-4601-82f3-d665b0972a63 None None] Releasing lock "compute-rpcapi-router" {{(pid=120481) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 10:54:36.637849 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-975c5784-45c1-4601-82f3-d665b0972a63 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.432840 Aug 31 10:54:36.639824 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 20/53] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:36.802291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:36.803086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:36.833301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:36.837349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:36.838145 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:36.848978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:36.848978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:36.848978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:37.336822 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:37.351196 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-10cf940c-f235-4dd6-97e8-9ed4017d500f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1246 microversion: 2.1 time: 0.559560 Aug 31 10:54:37.356037 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 21/54] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:36 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1246 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:37.378918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:37.381145 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:37.403067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:37.403573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:37.404295 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:37.405719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:37.406610 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:37.407912 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:38.131508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:38.162722 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-64ce3cdb-f587-4f87-ba5d-1c375b79efab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 1.767106 Aug 31 10:54:38.168241 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 34/55] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:36 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:38.542897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:38.555515 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4b1111c2-aa5f-41d6-bfba-d5a65bd2167b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 1.194583 Aug 31 10:54:38.557213 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 22/56] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:37 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:38.571125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:38.572086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:38.579770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-26ca2c2d-9588-48c8-85d4-ea2c9a247f82 req-a349ddfa-485a-4ad4-bbdf-fbfff198ce4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb885a17-8f70-412f-9319-6f48380cdeac", "tag": "695c308d-47b9-493b-9e2c-0c2ce77ab76b"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:38.587352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:38.588826 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:38.590323 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:38.592196 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:38.593575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:38.596192 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:38.605256 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-26ca2c2d-9588-48c8-85d4-ea2c9a247f82 req-a349ddfa-485a-4ad4-bbdf-fbfff198ce4c service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:38.605743 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-26ca2c2d-9588-48c8-85d4-ea2c9a247f82 req-a349ddfa-485a-4ad4-bbdf-fbfff198ce4c service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:38.606200 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-26ca2c2d-9588-48c8-85d4-ea2c9a247f82 req-a349ddfa-485a-4ad4-bbdf-fbfff198ce4c service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:38.670694 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-26ca2c2d-9588-48c8-85d4-ea2c9a247f82 req-a349ddfa-485a-4ad4-bbdf-fbfff198ce4c service nova] Creating event network-changed:695c308d-47b9-493b-9e2c-0c2ce77ab76b for instance bb885a17-8f70-412f-9319-6f48380cdeac on hv-cinder-79578 Aug 31 10:54:38.673308 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-26ca2c2d-9588-48c8-85d4-ea2c9a247f82 req-a349ddfa-485a-4ad4-bbdf-fbfff198ce4c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 10:54:38.674392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-26ca2c2d-9588-48c8-85d4-ea2c9a247f82 req-a349ddfa-485a-4ad4-bbdf-fbfff198ce4c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 10:54:38.678574 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af0325ae-4855-4a48-a8e4-ea416312fa6c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:38.679154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af0325ae-4855-4a48-a8e4-ea416312fa6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:38.679692 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af0325ae-4855-4a48-a8e4-ea416312fa6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:38.682971 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af0325ae-4855-4a48-a8e4-ea416312fa6c None None] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:38.683714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af0325ae-4855-4a48-a8e4-ea416312fa6c None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:38.684947 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af0325ae-4855-4a48-a8e4-ea416312fa6c None None] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:38.695426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.compute.rpcapi [None req-af0325ae-4855-4a48-a8e4-ea416312fa6c None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 10:54:38.697045 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af0325ae-4855-4a48-a8e4-ea416312fa6c None None] Releasing lock "compute-rpcapi-router" {{(pid=120482) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 10:54:38.718440 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-af0325ae-4855-4a48-a8e4-ea416312fa6c None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.547545 Aug 31 10:54:38.719851 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 35/57] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:38.733421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:38.734452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:38.753942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:38.757409 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:38.758195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:38.760133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:38.761460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:38.764230 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:38.919010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:38.931111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7dc2e963-5ace-4032-98f8-bafbadc4678e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1294 microversion: 2.1 time: 0.209697 Aug 31 10:54:38.933476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 36/58] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:38 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1294 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:38.968899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:38.978537 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0599ed78-7529-4de3-a175-62c386335af1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.419644 Aug 31 10:54:38.996498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 23/59] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:38 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:39.189600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:39.191085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:39.199397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:39.202257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:39.203874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:39.204826 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:39.208325 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:39.208899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:39.397562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-03e5c051-930c-4ffe-9c2b-35659ff723c5 req-c1504e19-a862-499c-9d93-eede4af6a8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62fc001e-fe00-44da-8493-aaf6fc2cd297", "tag": "da85246a-ae6a-4642-84f1-fc043b95c9b2"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:39.436974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-03e5c051-930c-4ffe-9c2b-35659ff723c5 req-c1504e19-a862-499c-9d93-eede4af6a8d1 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:39.440188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-03e5c051-930c-4ffe-9c2b-35659ff723c5 req-c1504e19-a862-499c-9d93-eede4af6a8d1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:39.442257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-03e5c051-930c-4ffe-9c2b-35659ff723c5 req-c1504e19-a862-499c-9d93-eede4af6a8d1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:39.502627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-03e5c051-930c-4ffe-9c2b-35659ff723c5 req-c1504e19-a862-499c-9d93-eede4af6a8d1 service nova] Creating event network-changed:da85246a-ae6a-4642-84f1-fc043b95c9b2 for instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 on hv-cinder-79578 Aug 31 10:54:39.508944 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-03e5c051-930c-4ffe-9c2b-35659ff723c5 req-c1504e19-a862-499c-9d93-eede4af6a8d1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116725 Aug 31 10:54:39.510542 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 24/60] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:54:39.594956 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:39.594956 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:39.625066 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:39.626980 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:39.627654 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:39.630177 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:39.630806 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:39.632237 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:40.206602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:40.222185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b4bd83e0-1a72-44f9-9cbd-4df254b5a247 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 1.034513 Aug 31 10:54:40.223212 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 37/61] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:39 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:40.236700 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:40.239419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:40.259029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:40.261034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:40.261887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:40.264420 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:40.266782 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:40.268771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:40.296424 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:40.308708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c7296d3d-c58a-4731-b3e9-fdba8188d85f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.731898 Aug 31 10:54:40.312207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 25/62] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:39 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:40.331065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:40.333362 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:40.348727 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:40.353170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:40.364353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:40.365066 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:40.366345 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:40.370336 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:40.371009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:40.474441 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:40.484609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a7df09b3-08f3-4413-b93c-eb21e778ebd3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1300 microversion: 2.1 time: 0.258277 Aug 31 10:54:40.485996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 38/63] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:40 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1300 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:40.674354 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:40.694762 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-76828dc6-e0b9-4b19-a126-56ef06cf8d5e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.380534 Aug 31 10:54:40.710185 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 26/64] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:40 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:41.129837 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-93086eb2-0fc0-4258-b66c-29f0cc725921 req-302e7c95-3dee-4dff-8ed2-d213e7b08b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2066e84d-41e5-4702-afe4-ebc89f6bab0b", "tag": "77f10698-fbac-43ca-b9d7-5b0670a8fc2b"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:41.140887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-93086eb2-0fc0-4258-b66c-29f0cc725921 req-302e7c95-3dee-4dff-8ed2-d213e7b08b40 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:41.141642 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-93086eb2-0fc0-4258-b66c-29f0cc725921 req-302e7c95-3dee-4dff-8ed2-d213e7b08b40 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:41.142339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-93086eb2-0fc0-4258-b66c-29f0cc725921 req-302e7c95-3dee-4dff-8ed2-d213e7b08b40 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:41.158790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-93086eb2-0fc0-4258-b66c-29f0cc725921 req-302e7c95-3dee-4dff-8ed2-d213e7b08b40 service nova] Creating event network-changed:77f10698-fbac-43ca-b9d7-5b0670a8fc2b for instance 2066e84d-41e5-4702-afe4-ebc89f6bab0b on hv-cinder-79578 Aug 31 10:54:41.166858 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-93086eb2-0fc0-4258-b66c-29f0cc725921 req-302e7c95-3dee-4dff-8ed2-d213e7b08b40 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041252 Aug 31 10:54:41.167785 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 39/65] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:41.244960 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:41.245951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:41.254455 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:41.254951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:41.255429 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:41.256458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:41.257163 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:41.257831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:41.332305 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:41.333029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:41.340333 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:41.340942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:41.341595 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:41.342401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:41.343127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:41.343606 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:41.699665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:41.711626 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3f232c98-5ec3-4453-aeb6-0ff78cb1c289 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.472001 Aug 31 10:54:41.713231 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 27/66] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:41 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:41.718953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:41.720280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:41.727672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:41.728604 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:41.729712 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:41.731108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:41.731726 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:41.732392 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:41.738247 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:41.833495 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:41.859133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:41.862584 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-99cd64af-5bf0-4283-b040-4e0580077e06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1300 microversion: 2.1 time: 0.147718 Aug 31 10:54:41.863379 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 28/67] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:41 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1300 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:41.868917 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:41.869529 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:41.884150 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3838359c-aca8-4d62-8384-ab1f94ed4667 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.552990 Aug 31 10:54:41.884804 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 40/68] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:41 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:41.888148 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:41.888641 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:41.889391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:41.890294 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:41.890896 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:41.891466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:42.080184 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:42.100534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9fdc272f-b3ee-48b5-937f-78389fbc9799 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.235756 Aug 31 10:54:42.113800 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 29/69] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:41 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:42.735604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:42.736421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:42.745182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:42.745734 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:42.748650 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:42.749401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:42.749891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:42.752120 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:42.885919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:42.886700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:42.899766 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:42.901091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:42.902357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:42.904396 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:42.917214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:42.917722 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:43.050275 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:43.058602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-22630111-33bf-49e1-a8e8-fbc63c37379c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.329240 Aug 31 10:54:43.059718 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 41/70] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:42 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:43.064891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:43.065764 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:43.082036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:43.082724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:43.083171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:43.083903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:43.085714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:43.087261 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:43.112718 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:43.120995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ad3f052c-6ebb-4ed4-bf63-b80cb8463835 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.240405 Aug 31 10:54:43.122102 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 30/71] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:42 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:43.126842 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:43.127698 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:43.133792 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:43.134513 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:43.135168 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:43.136175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:43.136890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:43.137513 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:43.323613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:43.332683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:43.335201 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-87fa378e-35d3-4a51-9e54-7dabdaeb183f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.273724 Aug 31 10:54:43.336838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 42/72] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:43 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:43.340995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-37f4f890-2c03-4d64-b6db-bd0a5c39573b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.217674 Aug 31 10:54:43.341560 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 31/73] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:43 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:44.079648 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:44.080269 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:44.086977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:44.088560 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:44.088998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:44.090052 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:44.090258 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:44.092502 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:44.145103 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:44.145718 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:44.156552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:44.157300 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:44.157974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:44.162348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:44.163027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:44.163508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:44.344144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:44.364705 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-fb6a84c9-01f6-49e7-b9ca-35bda714b245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.288413 Aug 31 10:54:44.367024 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 43/74] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:44 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:44.372951 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:44.373636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:44.385078 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:44.385905 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:44.386686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:44.387216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:44.388565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:44.389215 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:44.390338 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:44.394317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0b251f97-2bd9-48ef-9ecc-47ff04a643fe tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.252976 Aug 31 10:54:44.395393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 32/75] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:44 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:44.401680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:44.403630 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:44.412690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:44.413190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:44.413612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:44.414385 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:44.414842 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:44.415450 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:44.883828 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=6 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:45.457903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:45.477082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5aaeb032-e9e9-4c09-8c5b-f7df1ad0f3ec tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 1.108433 Aug 31 10:54:45.477734 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 44/76] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:44 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:45.501082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:45.505206 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:45.530500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:45.543346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:45.544134 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:45.544896 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:45.545045 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8b75ceb2-ae43-4c0f-9480-5c0b8680a470 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 1.146772 Aug 31 10:54:45.546213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:45.546805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:45.547371 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:45.549326 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 33/77] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:44 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:45.562623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=100 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:45.566552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:45.569870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:45.596262 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:45.604125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:45.606895 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:45.609223 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:45.612221 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:45.613300 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:45.767714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=24 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:45.972676 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:45.982082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-776ca250-f051-485e-852b-c2c0eccc9418 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.503235 Aug 31 10:54:45.987874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 45/78] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:45 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:46.330049 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:46.335571 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-7b527dd4-bd53-4632-94a5-f78445a8be0d req-3cbd5cc9-55fc-458d-b8de-e3ae20634898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cc77f5-17ed-46dc-bc9f-a927415fc639", "tag": "ec5b6938-c6c5-49ac-a90a-5196ce5d9611"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:46.363770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-7b527dd4-bd53-4632-94a5-f78445a8be0d req-3cbd5cc9-55fc-458d-b8de-e3ae20634898 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:46.368519 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-7b527dd4-bd53-4632-94a5-f78445a8be0d req-3cbd5cc9-55fc-458d-b8de-e3ae20634898 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:46.369282 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-7b527dd4-bd53-4632-94a5-f78445a8be0d req-3cbd5cc9-55fc-458d-b8de-e3ae20634898 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:46.391823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0c854349-012d-4ef2-b620-5cecb7faabe9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.835857 Aug 31 10:54:46.392908 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 34/79] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:45 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:46.457504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-7b527dd4-bd53-4632-94a5-f78445a8be0d req-3cbd5cc9-55fc-458d-b8de-e3ae20634898 service nova] Creating event network-changed:ec5b6938-c6c5-49ac-a90a-5196ce5d9611 for instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 on hv-cinder-79578 Aug 31 10:54:46.468614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-7b527dd4-bd53-4632-94a5-f78445a8be0d req-3cbd5cc9-55fc-458d-b8de-e3ae20634898 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137371 Aug 31 10:54:46.474357 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 46/80] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:46.500380 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:46.501495 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:46.511989 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:46.512474 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:46.513178 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:46.514127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:46.514575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:46.514995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:46.569436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:46.570386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:46.581028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:46.585199 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:46.585890 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:46.586757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:46.588833 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:46.590005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:46.617930 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=4 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:47.171007 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:47.178886 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-21f5b371-d9ac-4b3c-9fa0-77b25db6ec35 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.683536 Aug 31 10:54:47.179483 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 35/81] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:46 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:47.194662 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:47.195762 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:47.211512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:47.212267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:47.212931 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:47.214504 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:47.216020 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:47.218336 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:47.604021 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:47.618871 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-91563cef-4d8e-420f-b63b-34df0c868256 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 1.053924 Aug 31 10:54:47.620484 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 47/82] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:46 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:47.636584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:47.638085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:47.665206 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:47.667095 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:47.667731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:47.670675 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:47.672064 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:47.674168 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:47.821406 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:47.834945 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d55f29e9-b0bc-4489-b977-77dd33094be7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.654389 Aug 31 10:54:47.835725 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 36/83] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:47 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:48.028273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:48.038742 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5e407fc9-b55c-453a-a990-49da465ce9b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.415627 Aug 31 10:54:48.042297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 48/84] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:47 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:48.203508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:48.204142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:48.215670 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:48.216979 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:48.217429 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:48.218850 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:48.219311 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:48.220098 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:48.625165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:48.635603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-91e74de9-3dd9-4033-869a-e380b5261b53 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.436217 Aug 31 10:54:48.643335 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:48.644757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:48.650365 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 37/85] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:48 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:48.658959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:48.662205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:48.662713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:48.663441 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:48.675896 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:48.677816 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:48.737397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=4 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:48.858168 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:48.859766 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:48.868361 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:48.873525 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:48.878230 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:48.879234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:48.879997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:48.881332 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:48.966936 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:48.975781 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-bc215b2a-eed4-41a8-9196-684041bd2070 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.338752 Aug 31 10:54:48.977618 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 49/86] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:48 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:49.063575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:49.064376 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:49.074649 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:49.078088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:49.078581 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:49.079312 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:49.081455 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:49.081925 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:49.094513 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:49.105218 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d385be4f-3142-45be-b72f-aa2464f54e1f tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.252452 Aug 31 10:54:49.106108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 38/87] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:48 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:49.284088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:49.292847 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-33005023-1d6b-4ed1-a53e-70dc72055312 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.234478 Aug 31 10:54:49.306361 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 50/88] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:49 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:49.656692 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:49.657720 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:49.665198 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:49.666272 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:49.667602 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:49.668587 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:49.669457 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:49.670240 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:49.865050 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:49.874063 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-572f2d5d-ba5f-48f4-9112-42943d2e4544 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.221272 Aug 31 10:54:49.874889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 39/89] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:49 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:50.001208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:50.002401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:50.013415 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:50.016943 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:50.018476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:50.019426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:50.023965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:50.024670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:50.126569 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:50.127239 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:50.136481 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:50.136979 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:50.138459 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:50.141757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:50.141978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:50.142728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:50.213627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:50.224056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-dabde0c1-d9ae-48ff-a697-968aee89b826 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.227030 Aug 31 10:54:50.229080 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 51/90] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:49 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:50.314880 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:50.315658 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:50.329205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:50.329979 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:50.330416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:50.331123 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:50.331578 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:50.332005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:50.336642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:50.352443 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b14c977c-ea76-4d32-95b0-23ee74193ded tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.230287 Aug 31 10:54:50.353897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 40/91] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:50 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:50.665049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:50.688360 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8b979bdf-435f-4a1e-92c7-a0e87963bac3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.378336 Aug 31 10:54:50.689186 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 52/92] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:50 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:50.895554 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:50.896880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:50.904273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:50.905093 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:50.905944 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:50.906889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:50.907795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:50.908525 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:51.171500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:51.183067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-21c05dac-7a95-4539-8714-59fc55cb6dd4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.290419 Aug 31 10:54:51.184292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 41/93] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:50 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:51.245329 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:51.252801 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:51.256428 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-f64e7c3a-10e3-4c80-9852-78c3445c08ab req-a05da554-6d6c-4d54-ba1b-cbc8e258a8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c872949e-187f-4c56-a92e-46a8f341f1f8", "name": "network-vif-plugged", "status": "completed", "tag": "400efad8-4a73-4f8f-9ed3-32e061d542a8"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:51.263985 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:51.267499 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:51.267952 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:51.270200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:51.270679 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:51.272864 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:51.275680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-f64e7c3a-10e3-4c80-9852-78c3445c08ab req-a05da554-6d6c-4d54-ba1b-cbc8e258a8a7 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:51.277838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-f64e7c3a-10e3-4c80-9852-78c3445c08ab req-a05da554-6d6c-4d54-ba1b-cbc8e258a8a7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:51.278473 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-f64e7c3a-10e3-4c80-9852-78c3445c08ab req-a05da554-6d6c-4d54-ba1b-cbc8e258a8a7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:51.300696 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-f64e7c3a-10e3-4c80-9852-78c3445c08ab req-a05da554-6d6c-4d54-ba1b-cbc8e258a8a7 service nova] Creating event network-vif-plugged:400efad8-4a73-4f8f-9ed3-32e061d542a8 for instance c872949e-187f-4c56-a92e-46a8f341f1f8 on hv-cinder-79578 Aug 31 10:54:51.308671 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-f64e7c3a-10e3-4c80-9852-78c3445c08ab req-a05da554-6d6c-4d54-ba1b-cbc8e258a8a7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.303101 Aug 31 10:54:51.310592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 53/94] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:51.379474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:51.380691 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:51.406355 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:51.410687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:51.411325 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:51.414572 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:51.417921 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:51.418505 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:51.581716 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:51.593235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-dba29d34-9814-449c-a9bc-1c34cbc79bfd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.352133 Aug 31 10:54:51.596683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 42/95] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:51 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:51.701623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:51.712860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-aec5109b-c42e-4bda-8572-591305850591 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.342683 Aug 31 10:54:51.717822 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:51.717822 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:51.726871 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 54/96] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:51 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:51.740970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:51.742512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:51.742956 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:51.743706 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:51.744160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:51.744589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:52.182268 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:52.191796 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-145e1891-56d9-4f2a-9e28-ffea0056d376 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.485058 Aug 31 10:54:52.192939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 43/97] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:51 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:52.205294 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:52.212974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:52.220178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:52.225277 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:52.225838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:52.226558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:52.228931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:52.230082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:52.390884 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:52.398752 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-db4b817b-aa41-4d55-80a4-f0893ae76839 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.197247 Aug 31 10:54:52.399427 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 55/98] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:52 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:52.617688 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:52.618601 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:52.625423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:52.626209 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:52.626635 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:52.627616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:52.628109 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:52.628753 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:52.739049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:52.741160 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:52.750981 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:52.751686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:52.752454 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:52.753976 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:52.755303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:52.755938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:52.769724 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:52.773363 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:52.778815 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4fa1b788-2583-4947-a890-c6712896fb44 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.166578 Aug 31 10:54:52.779470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 44/99] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:52 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:52.900828 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:52.908900 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-be16d031-dabc-453d-b4cc-8194e6c1f3ca tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.177176 Aug 31 10:54:52.909470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 56/100] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:52 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:53.215479 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:53.216765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:53.228676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:53.228676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:53.228676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:53.228676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:53.228927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:53.228927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:53.335588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-a6fc158c-3713-4074-acdb-4a2154c7d186 req-09f5f512-0d2f-4475-bf94-6b67d0c807be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62fc001e-fe00-44da-8493-aaf6fc2cd297", "name": "network-vif-plugged", "status": "completed", "tag": "da85246a-ae6a-4642-84f1-fc043b95c9b2"}, {"server_uuid": "bb885a17-8f70-412f-9319-6f48380cdeac", "name": "network-vif-plugged", "status": "completed", "tag": "695c308d-47b9-493b-9e2c-0c2ce77ab76b"}, {"server_uuid": "2066e84d-41e5-4702-afe4-ebc89f6bab0b", "name": "network-vif-plugged", "status": "completed", "tag": "77f10698-fbac-43ca-b9d7-5b0670a8fc2b"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:53.348309 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-a6fc158c-3713-4074-acdb-4a2154c7d186 req-09f5f512-0d2f-4475-bf94-6b67d0c807be service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:53.349075 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-a6fc158c-3713-4074-acdb-4a2154c7d186 req-09f5f512-0d2f-4475-bf94-6b67d0c807be service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:53.349571 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-a6fc158c-3713-4074-acdb-4a2154c7d186 req-09f5f512-0d2f-4475-bf94-6b67d0c807be service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:53.372071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-a6fc158c-3713-4074-acdb-4a2154c7d186 req-09f5f512-0d2f-4475-bf94-6b67d0c807be service nova] Creating event network-vif-plugged:da85246a-ae6a-4642-84f1-fc043b95c9b2 for instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 on hv-cinder-79578 Aug 31 10:54:53.372665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-a6fc158c-3713-4074-acdb-4a2154c7d186 req-09f5f512-0d2f-4475-bf94-6b67d0c807be service nova] Creating event network-vif-plugged:695c308d-47b9-493b-9e2c-0c2ce77ab76b for instance bb885a17-8f70-412f-9319-6f48380cdeac on hv-cinder-79578 Aug 31 10:54:53.373334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-a6fc158c-3713-4074-acdb-4a2154c7d186 req-09f5f512-0d2f-4475-bf94-6b67d0c807be service nova] Creating event network-vif-plugged:77f10698-fbac-43ca-b9d7-5b0670a8fc2b for instance 2066e84d-41e5-4702-afe4-ebc89f6bab0b on hv-cinder-79578 Aug 31 10:54:53.382326 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-a6fc158c-3713-4074-acdb-4a2154c7d186 req-09f5f512-0d2f-4475-bf94-6b67d0c807be service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051118 Aug 31 10:54:53.382936 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 57/101] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:53.411301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:53.420312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6d07bc8c-c2d1-4aa1-a8d5-6bc95b303a7d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.210580 Aug 31 10:54:53.421609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 45/102] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:53 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:53.423766 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:53.424418 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:53.433630 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:53.434151 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:53.434590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:53.435372 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:53.435825 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:53.436428 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:53.577798 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:53.587071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f8de89be-9315-4125-9a12-7bb14478a9d6 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.170197 Aug 31 10:54:53.587845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 58/103] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:53 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:53.804359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:53.804359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:53.808603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:53.809391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:53.810082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:53.810850 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:53.811569 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:53.812035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:53.929762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:53.930523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:53.939531 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:53.943299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:53.944000 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:53.945800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:53.946459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:53.947558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:53.997136 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:54.006863 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4aea48bb-b910-4a38-a41f-828344e54d9f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.209739 Aug 31 10:54:54.008220 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 46/104] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:53 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:54.131440 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:54.139669 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2c089e3e-6728-4d36-a135-f6b3733ebba3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.213961 Aug 31 10:54:54.140240 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 59/105] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:53 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:54.443092 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:54.444199 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:54.450514 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:54.450925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:54.451590 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:54.452680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:54.453729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:54.454403 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:54.608777 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:54.610023 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:54.622122 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:54.622122 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:54.622122 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:54.622122 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:54.622426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:54.624515 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:54.681356 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:54.698028 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e6e239c3-4a3d-443a-89f9-33fefe49fb40 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.259361 Aug 31 10:54:54.698912 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 47/106] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:54 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:54.859678 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:54.871966 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-803cc176-c147-4ad5-a6e9-aa415ea6233c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.267360 Aug 31 10:54:54.874232 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 60/107] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:54 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:55.027346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:55.028358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:55.034506 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:55.034995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:55.035776 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:55.036638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:55.037626 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:55.038291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:55.162929 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:55.163775 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:55.174733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:55.175271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:55.175912 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:55.176962 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:55.177891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:55.178619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:55.194894 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:55.206255 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-39b898d6-f421-4cf9-91a6-842086bd1ae0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.180992 Aug 31 10:54:55.206906 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 48/108] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:55 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:55.377761 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:55.389665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a20d01c3-a436-41ed-9b67-0f8d34f25eba tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.232250 Aug 31 10:54:55.390667 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 61/109] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:55 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:55.719349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:55.720736 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:55.728795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:55.729290 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:55.729726 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:55.730643 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:55.731127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:55.731671 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:55.881762 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:55.896663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:55.897293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:55.917308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7bb44e1b-49a7-42b7-b6b3-358fb988709a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.198027 Aug 31 10:54:55.918513 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:55.919017 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 49/110] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:55 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:55.919978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:55.920557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:55.921793 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:55.922431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:55.923551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:56.139418 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:56.147905 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-104687d9-ce92-4732-8181-3b0baa940e15 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.257800 Aug 31 10:54:56.148711 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 62/111] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:55 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:56.229205 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:56.230090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:56.239861 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:56.240820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:56.241672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:56.243019 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:56.243876 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:56.244561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:56.407033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:56.412339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:56.413616 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:56.420983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-68c2b3e9-60af-4260-a612-bbc1d3ed3214 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.193053 Aug 31 10:54:56.421413 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:56.421597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 50/112] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:56 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:56.422688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:56.422957 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:56.424523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:56.425544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:56.426148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:56.577584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:56.582856 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=100 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:56.593289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-83ac8bde-7da1-454a-b5e7-416b79974e62 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.185010 Aug 31 10:54:56.596878 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 63/113] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:56 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:56.938527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:56.939143 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:56.945095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:56.945579 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:56.946038 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:56.946901 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:56.947344 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:56.947937 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:57.087375 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:57.100074 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-aab80d0f-51a4-4446-8a31-af29d67437b8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.165245 Aug 31 10:54:57.101807 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 51/114] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:56 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:57.169368 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:57.170106 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:57.177703 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:57.178353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:57.179045 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:57.179845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:57.180378 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:57.180810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:57.327815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:57.337826 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-bb1c7445-0e2d-4c52-b9ff-6697d980ed9f tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.172686 Aug 31 10:54:57.338327 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 64/115] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:57 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:57.444907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:57.445812 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:57.451947 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:57.452431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:57.452892 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:57.453792 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:57.454234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:57.454650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:57.595855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:57.603911 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b0fb0640-f26e-4eb7-b33d-eeb6196250c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.163101 Aug 31 10:54:57.604610 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 52/116] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:57 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:54:57.622323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:57.622952 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:57.629402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:57.629972 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:57.630385 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:57.631174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:57.631677 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:57.632290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:57.852467 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:57.861239 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d0e6a601-5958-452f-865c-45b4588a4018 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.242969 Aug 31 10:54:57.862844 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 65/117] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:57 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:57.891838 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-054f5b7d-41dd-4435-8bd5-324194463798 req-173f7a29-e0db-4b9c-b616-6f77648f3cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cc77f5-17ed-46dc-bc9f-a927415fc639", "name": "network-vif-plugged", "status": "completed", "tag": "ec5b6938-c6c5-49ac-a90a-5196ce5d9611"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:54:57.904174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-054f5b7d-41dd-4435-8bd5-324194463798 req-173f7a29-e0db-4b9c-b616-6f77648f3cd8 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:57.904779 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-054f5b7d-41dd-4435-8bd5-324194463798 req-173f7a29-e0db-4b9c-b616-6f77648f3cd8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:57.905192 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-054f5b7d-41dd-4435-8bd5-324194463798 req-173f7a29-e0db-4b9c-b616-6f77648f3cd8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:57.920008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-054f5b7d-41dd-4435-8bd5-324194463798 req-173f7a29-e0db-4b9c-b616-6f77648f3cd8 service nova] Creating event network-vif-plugged:ec5b6938-c6c5-49ac-a90a-5196ce5d9611 for instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 on hv-cinder-79578 Aug 31 10:54:57.925606 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-054f5b7d-41dd-4435-8bd5-324194463798 req-173f7a29-e0db-4b9c-b616-6f77648f3cd8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037668 Aug 31 10:54:57.926228 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 53/118] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:54:58.121567 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:58.122322 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:58.128516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:58.129003 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:58.129568 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:58.130399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:58.130901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:58.131440 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:58.276684 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:58.284716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-64560358-a04b-4ea5-8cdd-d761564a02a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.167664 Aug 31 10:54:58.285366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 66/119] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:58 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:58.364926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:58.367599 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:58.379605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:58.380463 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:58.381290 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:58.382006 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:58.382449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:58.382864 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:58.521401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:58.529628 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5f657714-36f1-43a9-9a7a-d711f1a96145 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1315 microversion: 2.1 time: 0.173728 Aug 31 10:54:58.530218 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 54/120] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:58 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:58.629258 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:58.630384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:58.643494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:58.644282 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:58.645048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:58.646236 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:58.647034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:58.647448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:58.854489 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:58.864622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-be1d2d0f-a015-4bfd-96da-1dd2a5dc6fc7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.242122 Aug 31 10:54:58.865201 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 67/121] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:58 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:58.887796 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:58.888407 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:58.894647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:58.895125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:58.895542 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:58.896233 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:58.896731 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:58.897146 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:59.029457 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:59.045355 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fd6b6913-9f92-43da-9d97-92f311e22817 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.156599 Aug 31 10:54:59.046251 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 55/122] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:58 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:59.305283 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:59.306065 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:59.312857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:59.313343 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:59.313809 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:59.314490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:59.314941 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:59.315397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:59.459289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:59.467044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ce1f47cc-4aa9-4fef-a089-4d8879b3f7ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.165756 Aug 31 10:54:59.467606 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 68/123] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:59 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:59.550551 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:59.551169 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:59.558201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:59.558636 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:59.559065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:59.559749 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:59.560197 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:59.560618 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:59.697990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:54:59.706154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0124feaa-cddc-492a-a18b-581aaedcc02c tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1502 microversion: 2.1 time: 0.160000 Aug 31 10:54:59.706731 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 56/124] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:59 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:54:59.887832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:54:59.888652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:54:59.898693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:59.899208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:59.899733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:54:59.900571 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:54:59.901027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:54:59.901449 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:00.071049 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:00.072087 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:00.082783 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:00.084142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:00.085341 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:00.086100 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:00.086564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:00.086994 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:00.120003 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:00.134523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0350b691-68a9-4aeb-ad27-d569febe8df9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.252834 Aug 31 10:55:00.151138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 69/125] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:54:59 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:00.290684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:00.300822 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-cc1c5a4d-401e-4bec-8cea-3c75b9c1ce2a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1364 microversion: 2.1 time: 0.234152 Aug 31 10:55:00.313866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 57/126] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:00 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:00.488099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:00.488703 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:00.497931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:00.498419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:00.498851 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:00.499604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:00.500039 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:00.500457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:00.633232 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:00.641742 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-81ea2b53-68e5-4402-a886-2f3bed06c60e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.157570 Aug 31 10:55:00.642390 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 70/127] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:00 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:01.161319 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:01.162360 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:01.169363 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.169893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.170324 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:01.171063 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.171826 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.172287 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:01.181310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6fb3aa4d-8fd7-4bfc-a220-e76158d0e3c7 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aefe9f9-eec3-41c9-8c70-ba34ae10ac07"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:01.184399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6fb3aa4d-8fd7-4bfc-a220-e76158d0e3c7 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:01.190658 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fb3aa4d-8fd7-4bfc-a220-e76158d0e3c7 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.191446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fb3aa4d-8fd7-4bfc-a220-e76158d0e3c7 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.191986 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fb3aa4d-8fd7-4bfc-a220-e76158d0e3c7 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:01.196626 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fb3aa4d-8fd7-4bfc-a220-e76158d0e3c7 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.197310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fb3aa4d-8fd7-4bfc-a220-e76158d0e3c7 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.198067 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fb3aa4d-8fd7-4bfc-a220-e76158d0e3c7 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:01.350461 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:01.359890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c13603bb-6604-4f2e-82a5-5c5918ff9faf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1322 microversion: 2.1 time: 0.202534 Aug 31 10:55:01.365919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 58/128] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:01 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:01.372862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:01.373852 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:01.390905 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.391761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.392406 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:01.394383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.395292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.395967 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:01.627198 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:01.636214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5d3eb848-8511-40a7-aca8-522fbf02ac52 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1550 microversion: 2.1 time: 0.268554 Aug 31 10:55:01.637232 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 59/129] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:01 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1550 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:01.659794 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b742018b-2965-47e2-8d9a-42f745c220c3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:01.660520 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b742018b-2965-47e2-8d9a-42f745c220c3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:01.668970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b742018b-2965-47e2-8d9a-42f745c220c3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.669824 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b742018b-2965-47e2-8d9a-42f745c220c3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.670540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b742018b-2965-47e2-8d9a-42f745c220c3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:01.671877 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b742018b-2965-47e2-8d9a-42f745c220c3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.672636 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b742018b-2965-47e2-8d9a-42f745c220c3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.673370 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b742018b-2965-47e2-8d9a-42f745c220c3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:01.838126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b742018b-2965-47e2-8d9a-42f745c220c3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182532 Aug 31 10:55:01.850038 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 60/130] 10.222.0.75 () {58 vars in 1275 bytes} [Wed Aug 31 10:55:01 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/os-interface => generated 285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:55:01.859235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:01.860409 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:01.867835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.868257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.868929 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:01.869829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:01.870593 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:01.871284 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:02.031621 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:02.041156 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-867456f1-1e2f-4a16-8e14-734ab321fbdf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.186909 Aug 31 10:55:02.041751 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 61/131] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:01 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:02.392166 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:02.394329 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:02.411633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:02.412139 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:02.414535 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:02.416184 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:02.416896 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:02.417391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:02.444431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:02.561380 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:02.569314 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ad544ff1-f0c1-4870-baf6-fa77aa3f4f12 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1515 microversion: 2.1 time: 0.186081 Aug 31 10:55:02.569921 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 62/132] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:02 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:02.592323 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:02.596835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:02.604032 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:02.604631 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:02.605152 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:02.606011 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:02.606604 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:02.607056 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:02.632963 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lazy-loading 'flavor' on Instance uuid 2066e84d-41e5-4702-afe4-ebc89f6bab0b {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:55:02.805502 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-dca9ef0e-8682-4ae6-935f-6464c7392a82 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b/action" status: 200 len: 32 microversion: 2.1 time: 0.206986 Aug 31 10:55:02.805502 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 63/133] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:55:02 2022] POST /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 10:55:02.824624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:02.830837 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:02.844370 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:02.844882 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:02.845317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:02.846091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:02.846586 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:02.847036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:03.001200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:03.016014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3e429d3b-25a0-4f90-88dd-48021684c2c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.206331 Aug 31 10:55:03.018061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 64/134] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:02 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:03.064164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:03.065086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:03.078551 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:03.079048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:03.079475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:03.080182 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:03.080780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:03.081046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:03.284390 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:03.297860 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-680b8b0e-af8d-4113-8ace-be830b5dab05 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1368 microversion: 2.1 time: 0.238630 Aug 31 10:55:03.299500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 65/135] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:03 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:03.631787 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-3cdefc4d-5fa0-4941-ae87-f3a319990c72 req-275b070b-dc35-49a6-ac25-37ae97529de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62fc001e-fe00-44da-8493-aaf6fc2cd297", "tag": "da85246a-ae6a-4642-84f1-fc043b95c9b2"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:03.644025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-3cdefc4d-5fa0-4941-ae87-f3a319990c72 req-275b070b-dc35-49a6-ac25-37ae97529de3 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:03.644958 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-3cdefc4d-5fa0-4941-ae87-f3a319990c72 req-275b070b-dc35-49a6-ac25-37ae97529de3 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:03.645597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-3cdefc4d-5fa0-4941-ae87-f3a319990c72 req-275b070b-dc35-49a6-ac25-37ae97529de3 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:03.660498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-3cdefc4d-5fa0-4941-ae87-f3a319990c72 req-275b070b-dc35-49a6-ac25-37ae97529de3 service nova] Creating event network-changed:da85246a-ae6a-4642-84f1-fc043b95c9b2 for instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 on hv-cinder-79578 Aug 31 10:55:03.675989 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-3cdefc4d-5fa0-4941-ae87-f3a319990c72 req-275b070b-dc35-49a6-ac25-37ae97529de3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047122 Aug 31 10:55:03.676969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 66/136] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:55:04.041828 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:04.044000 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:04.053758 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:04.054793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:04.055415 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:04.056479 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:04.057478 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:04.058126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:04.094348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6fb3aa4d-8fd7-4bfc-a220-e76158d0e3c7 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "POST /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.917443 Aug 31 10:55:04.100197 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 71/137] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 10:55:01 2022] POST /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8/os-volume_attachments => generated 194 bytes in 2919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:55:04.268800 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:04.278123 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a0413990-956d-436a-9d98-dddd2d4af087 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.241869 Aug 31 10:55:04.278829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 67/138] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:04 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:04.326826 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:04.328103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:04.338202 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:04.338887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:04.339802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:04.340783 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:04.341377 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:04.341965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:04.532953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:04.542014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4190a0b5-4034-4689-8c77-7d550392c4cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1558 microversion: 2.1 time: 0.223692 Aug 31 10:55:04.559042 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 72/139] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:04 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1558 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:04.567046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8b272f7e-e127-42c4-836b-b0a8787e0bd8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:04.567046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8b272f7e-e127-42c4-836b-b0a8787e0bd8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:04.573237 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b272f7e-e127-42c4-836b-b0a8787e0bd8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:04.573733 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b272f7e-e127-42c4-836b-b0a8787e0bd8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:04.574200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b272f7e-e127-42c4-836b-b0a8787e0bd8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:04.575869 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b272f7e-e127-42c4-836b-b0a8787e0bd8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:04.576473 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b272f7e-e127-42c4-836b-b0a8787e0bd8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:04.577211 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b272f7e-e127-42c4-836b-b0a8787e0bd8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:04.712797 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8b272f7e-e127-42c4-836b-b0a8787e0bd8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151206 Aug 31 10:55:04.713372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 68/140] 10.222.0.75 () {58 vars in 1275 bytes} [Wed Aug 31 10:55:04 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:55:05.299503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:05.301082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:05.310109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:05.310839 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:05.311274 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:05.311981 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:05.312458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:05.312878 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:05.706522 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:05.714745 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8718f892-5676-45f7-af2b-d07d5081a467 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.419374 Aug 31 10:55:05.715324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 73/141] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:05 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:06.293349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-e25d6e6a-97bd-4f0b-a877-8ba91b8ea646 req-f219adc9-9d92-483e-9ad1-cd6b3f4d26ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cc77f5-17ed-46dc-bc9f-a927415fc639", "tag": "ec5b6938-c6c5-49ac-a90a-5196ce5d9611"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:06.305079 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-e25d6e6a-97bd-4f0b-a877-8ba91b8ea646 req-f219adc9-9d92-483e-9ad1-cd6b3f4d26ed service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:06.305684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-e25d6e6a-97bd-4f0b-a877-8ba91b8ea646 req-f219adc9-9d92-483e-9ad1-cd6b3f4d26ed service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:06.306229 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-e25d6e6a-97bd-4f0b-a877-8ba91b8ea646 req-f219adc9-9d92-483e-9ad1-cd6b3f4d26ed service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:06.320239 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-e25d6e6a-97bd-4f0b-a877-8ba91b8ea646 req-f219adc9-9d92-483e-9ad1-cd6b3f4d26ed service nova] Creating event network-changed:ec5b6938-c6c5-49ac-a90a-5196ce5d9611 for instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 on hv-cinder-79578 Aug 31 10:55:06.326795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-e25d6e6a-97bd-4f0b-a877-8ba91b8ea646 req-f219adc9-9d92-483e-9ad1-cd6b3f4d26ed service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037647 Aug 31 10:55:06.327523 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 69/142] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:55:06.736775 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:06.737392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:06.741106 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=80 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:06.746168 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:06.746934 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:06.747391 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:06.748105 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:06.748561 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:06.749030 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:06.884097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:06.894343 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9d5f376c-bf5a-4560-9c58-199d10d68085 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.161417 Aug 31 10:55:06.894953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 74/143] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:06 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:07.918381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:07.920451 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:07.930806 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:07.932317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:07.932913 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:07.933879 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:07.934463 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:07.935018 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:08.249091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:08.258333 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-cf32f27c-da53-4efc-ac4f-9e40463ed4b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.345393 Aug 31 10:55:08.271846 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 70/144] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:07 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:09.282549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:09.284819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:09.301537 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:09.302551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:09.302980 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:09.304322 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:09.305688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:09.306475 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:09.468798 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:09.482228 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-def0f353-f24d-466a-b3cc-3c6cdc4814d4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.206278 Aug 31 10:55:09.483213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 75/145] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:09 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:10.502756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:10.503759 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:10.507310 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=89 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:10.511079 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:10.511855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:10.512531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:10.513599 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:10.514086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:10.514553 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:10.688479 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:10.697100 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-546d2fcb-dada-4a22-b20b-8476b4585b3b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.198485 Aug 31 10:55:10.697676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 71/146] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:10 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:11.718789 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:11.720211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:11.726993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:11.727942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:11.728551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:11.729428 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:11.730076 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:11.730653 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:11.977382 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:12.002652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cd700f0f-103d-4620-b546-86566961bd40 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.287695 Aug 31 10:55:12.003452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 76/147] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:11 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:13.024220 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:13.024820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:13.031378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:13.031884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:13.032318 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:13.033015 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:13.033473 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:13.034056 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:13.191215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:13.203697 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bf6cda33-7a03-4e2b-9275-870b2551ec68 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.183479 Aug 31 10:55:13.204298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 72/148] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:13 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:14.225366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:14.226209 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:14.236019 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:14.237265 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:14.237395 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:14.238102 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:14.238563 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:14.238971 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:14.418511 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:14.430148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e3784572-ed48-479a-8b62-8a92f66147a3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.209144 Aug 31 10:55:14.431280 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 77/149] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:14 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:15.451925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:15.453278 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:15.463500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:15.464727 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:15.465395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:15.466360 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:15.467022 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:15.467638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:15.718713 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:15.731065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6d053e0f-754c-4f6b-b2ba-c1ad3652c004 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.282679 Aug 31 10:55:15.731949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 73/150] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:15 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:16.752279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:16.753548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:16.762266 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:16.762980 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:16.763569 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:16.764431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:16.765019 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:16.765577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:16.950906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:16.960177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a1fcc056-5a1c-4795-97bd-a840b0785f7d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.211887 Aug 31 10:55:16.961067 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 78/151] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:16 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:17.983707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:17.984534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:17.990770 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:17.991225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:17.991704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:17.992398 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:17.992839 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:17.993437 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:18.163217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:18.175185 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e2ef4333-9abf-483e-a127-2211c8195f06 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.196619 Aug 31 10:55:18.175915 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 74/152] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:17 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:18.661553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-710146315", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "networks": [{"uuid": "1d1650f7-b587-4bdd-9b6c-844e03dbdc21"}]}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:18.737177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] validate_networks() for [('1d1650f7-b587-4bdd-9b6c-844e03dbdc21', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:55:19.196840 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:19.197506 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:19.203823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:19.204305 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:19.204733 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:19.205422 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:19.205899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:19.206327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:19.421441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:19.438817 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b84a9867-674d-4540-bc4f-56bb45776018 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.246064 Aug 31 10:55:19.439409 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 75/153] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:19 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:19.450033 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:55:19.450451 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:55:19.451114 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:55:19.451516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:55:19.451928 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:55:19.461544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:19.462102 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:19.462525 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:19.463231 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:19.463675 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:19.464084 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:19.471713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:19.491287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Getting quotas for project c7fb12ca0da546dcbcff810209d6fc40. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:55:19.499892 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Getting quotas for user fc33c6252cf04fd984cdcfe3913e3dcc and project c7fb12ca0da546dcbcff810209d6fc40. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:55:19.512048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:55:19.514516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:55:19.571076 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a6357b87-5965-4e61-af89-7be910610792 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914595 Aug 31 10:55:19.571722 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 79/154] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:55:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:55:19.583838 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b6a7f4cd-90c4-4f85-bda8-a6b7afac2b73 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:19.584922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b6a7f4cd-90c4-4f85-bda8-a6b7afac2b73 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:19.629581 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:19.630088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:19.636297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:19.636776 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:19.637204 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:19.637936 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:19.638383 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:19.638799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:19.649798 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b6a7f4cd-90c4-4f85-bda8-a6b7afac2b73 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:19.659053 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b6a7f4cd-90c4-4f85-bda8-a6b7afac2b73 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1213 microversion: 2.1 time: 0.080062 Aug 31 10:55:19.661300 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 76/155] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:19 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:19.667941 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:55:19.768498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d8f8447e-eced-4fdf-bf15-557221b2c198 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 204 len: 0 microversion: 2.1 time: 0.142499 Aug 31 10:55:19.769088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 80/156] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:55:19 2022] DELETE /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 10:55:19.778794 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:19.779539 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:19.786524 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:19.786984 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:19.787418 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:19.788130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:19.788638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:19.789068 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:19.939907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:19.948909 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-32f88ce2-c851-4396-a653-3717c762ca68 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1554 microversion: 2.1 time: 0.174799 Aug 31 10:55:19.949843 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 77/157] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:19 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:20.463173 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:20.464177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:20.472394 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:20.473078 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:20.473584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:20.474550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:20.475190 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:20.475861 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:20.636636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:20.644877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-278f3208-d9ca-415c-b70e-0c5791efa027 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.188671 Aug 31 10:55:20.645551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 81/158] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:20 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:20.680540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:20.682622 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:20.689653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:20.690355 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:20.691078 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:20.691566 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:20.692021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:20.692467 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:20.763844 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:20.772883 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f8a7127e-bdff-4a89-8f5f-4e45ba266642 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1217 microversion: 2.1 time: 0.096132 Aug 31 10:55:20.773975 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 78/159] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:20 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:20.971708 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:20.972339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:20.980194 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:20.980684 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:20.981115 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:20.982023 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:20.982474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:20.983329 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:21.124279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:21.133550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-61c42982-650f-4546-84a0-c98e0bd3d1a4 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1554 microversion: 2.1 time: 0.166655 Aug 31 10:55:21.134257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 82/160] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:20 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:21.669138 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:21.670048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:21.676626 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:21.677308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:21.677746 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:21.678482 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:21.679255 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:21.679637 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:21.795525 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:21.796137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:21.802652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:21.803433 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:21.804122 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:21.804324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:21.804946 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:21.805707 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:21.829328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:21.835898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:21.843992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7b1cec1c-4431-42cb-bb50-ea806989882b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.179158 Aug 31 10:55:21.846249 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 79/161] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:21 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:21.881859 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:21.890330 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6f712496-4fff-4da8-8e86-6645783fbfcb tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1209 microversion: 2.1 time: 0.099194 Aug 31 10:55:21.891004 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 83/162] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:21 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:22.155452 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:22.155898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:22.163405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:22.163976 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:22.164472 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:22.165371 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:22.166150 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:22.166747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:22.363754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:22.375761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7d0868e2-f614-49f6-9395-5aac9896d0cd tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1554 microversion: 2.1 time: 0.224419 Aug 31 10:55:22.376533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 80/163] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:22 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:22.868198 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:22.869092 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:22.894623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:22.896354 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:22.896813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:22.899645 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:22.900127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:22.900563 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:22.915597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:22.933300 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:22.950534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:22.952638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:22.953273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:22.954775 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:22.957377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:22.958080 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:23.156937 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:23.174961 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7568c591-d2fe-4de7-8149-6886b9f2ab0c tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1273 microversion: 2.1 time: 0.263118 Aug 31 10:55:23.201070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 81/164] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:22 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:23.219090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-f59d27b7-fc9a-44a4-b0f5-fa3a4be7dfc9 req-5f205b6c-687f-413d-aace-3e634eddc6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c872949e-187f-4c56-a92e-46a8f341f1f8", "name": "network-vif-deleted", "tag": "400efad8-4a73-4f8f-9ed3-32e061d542a8"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:23.238419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-f59d27b7-fc9a-44a4-b0f5-fa3a4be7dfc9 req-5f205b6c-687f-413d-aace-3e634eddc6c6 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:23.240385 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-f59d27b7-fc9a-44a4-b0f5-fa3a4be7dfc9 req-5f205b6c-687f-413d-aace-3e634eddc6c6 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:23.241234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-f59d27b7-fc9a-44a4-b0f5-fa3a4be7dfc9 req-5f205b6c-687f-413d-aace-3e634eddc6c6 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:23.257640 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-f59d27b7-fc9a-44a4-b0f5-fa3a4be7dfc9 req-5f205b6c-687f-413d-aace-3e634eddc6c6 service nova] Creating event network-vif-deleted:400efad8-4a73-4f8f-9ed3-32e061d542a8 for instance c872949e-187f-4c56-a92e-46a8f341f1f8 on hv-cinder-79578 Aug 31 10:55:23.264758 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-f59d27b7-fc9a-44a4-b0f5-fa3a4be7dfc9 req-5f205b6c-687f-413d-aace-3e634eddc6c6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059095 Aug 31 10:55:23.266047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 82/165] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:55:23.397018 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:23.397719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:23.409383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:23.410132 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:23.410729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:23.411766 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:23.412354 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:23.412919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:23.622532 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:23.634861 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2d355e71-61d0-4e56-94c4-925deea24ad0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.771448 Aug 31 10:55:23.635915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 84/166] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:22 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:23.646701 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c31a0c08c7a249caadd609a3e772c1c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa7cb99f3b44a85b984b80ad08e17c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:23.687218 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c99a9984-8a28-4a0a-b9fa-cab6140fe0df tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 200 len: 1346 microversion: 2.1 time: 0.294348 Aug 31 10:55:23.695291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 83/167] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:23 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 1346 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:24.226646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:24.227264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:24.242028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:24.243048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:24.243652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:24.244545 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:24.245603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:24.247022 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:24.540417 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:24.551783 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d4a53cb2-0233-421e-94c2-41f36bbd8c3a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1313 microversion: 2.1 time: 0.330263 Aug 31 10:55:24.553060 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 85/168] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:24 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1313 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:24.658778 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:24.659487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:24.670461 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:24.671093 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:24.672112 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:24.673729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:24.674413 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:24.675140 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:24.717790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:24.719213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:24.735635 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:24.747508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:24.747965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:24.748892 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:24.749355 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:24.749804 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:24.775518 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] HTTP exception thrown: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Request method failure captured: Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 HTTP/1.1 Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3Xf23koeSBwOWlv34VcPMxQBga7RuiMBqC2VakSTNuPe4Dd-EPuxVOWLMnvfDSH2ECwhRiTMUCxshZ4JiSn185oWpu4Vt_GfTVmiCQ0AuxR3mnRBA9yp2nesTKfXII7_VcALk8ByCstR9wnYxEtKtVUUHd2b7k1t_8h-NPqBgwRNw Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 1aa7cb99f3b44a85b984b80ad08e17c5 Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:55:24.784974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1aa7cb99f3b44a85b984b80ad08e17c5"}]}] Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 1aa7cb99f3b44a85b984b80ad08e17c5 Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-DeleteServersTestJSON-2084064227-project Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: c31a0c08c7a249caadd609a3e772c1c2 Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-DeleteServersTestJSON-2084064227-project Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:24.786447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'c872949e-187f-4c56-a92e-46a8f341f1f8'} Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:55:24.787129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:24.788234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:24.789289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Returning 404 to user: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:55:24.789289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d7c1f3c9-f0d7-4bfa-854d-c4133ca2cc3b tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 404 len: 111 microversion: 2.1 time: 0.074850 Aug 31 10:55:24.789289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 86/169] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:24 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:24.953088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:24.955733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:24.960031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:24.974231 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3773cbc0-8f01-46c7-9917-31948e5090c5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.321192 Aug 31 10:55:24.974871 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 84/170] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:24 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:24.989885 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:24.990478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:24.990957 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:24.992466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:24.992953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:24.993387 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:25.014982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] HTTP exception thrown: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Request method failure captured: Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8/os-volume_attachments HTTP/1.1 Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3Xf23koeSBwOWlv34VcPMxQBga7RuiMBqC2VakSTNuPe4Dd-EPuxVOWLMnvfDSH2ECwhRiTMUCxshZ4JiSn185oWpu4Vt_GfTVmiCQ0AuxR3mnRBA9yp2nesTKfXII7_VcALk8ByCstR9wnYxEtKtVUUHd2b7k1t_8h-NPqBgwRNw Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 1aa7cb99f3b44a85b984b80ad08e17c5 Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:55:25.016953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1aa7cb99f3b44a85b984b80ad08e17c5"}]}] Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 1aa7cb99f3b44a85b984b80ad08e17c5 Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-DeleteServersTestJSON-2084064227-project Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: c31a0c08c7a249caadd609a3e772c1c2 Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-DeleteServersTestJSON-2084064227-project Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:25.018713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'server_id': 'c872949e-187f-4c56-a92e-46a8f341f1f8'} Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:55:25.019452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:25.020566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:25.021607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Returning 404 to user: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:55:25.021607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2c8992c8-e3d0-4a5b-ab59-bb21aaed7adb tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071655 Aug 31 10:55:25.025825 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 87/171] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 10:55:24 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8/os-volume_attachments => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 10:55:25.316539 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-2abd5ede-c608-4dc3-8e44-e7f6a5804d45 req-88f04454-b4cc-4f5d-b03f-ee30abd3399b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaacfb17-5746-40d9-9c36-a01451d45f79", "tag": "cb442099-5824-431a-ba42-8409b540a812"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:25.331046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-2abd5ede-c608-4dc3-8e44-e7f6a5804d45 req-88f04454-b4cc-4f5d-b03f-ee30abd3399b service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:25.334038 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-2abd5ede-c608-4dc3-8e44-e7f6a5804d45 req-88f04454-b4cc-4f5d-b03f-ee30abd3399b service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:25.335890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-2abd5ede-c608-4dc3-8e44-e7f6a5804d45 req-88f04454-b4cc-4f5d-b03f-ee30abd3399b service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:25.350280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-2abd5ede-c608-4dc3-8e44-e7f6a5804d45 req-88f04454-b4cc-4f5d-b03f-ee30abd3399b service nova] Creating event network-changed:cb442099-5824-431a-ba42-8409b540a812 for instance eaacfb17-5746-40d9-9c36-a01451d45f79 on hv-cinder-79578 Aug 31 10:55:25.363208 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-2abd5ede-c608-4dc3-8e44-e7f6a5804d45 req-88f04454-b4cc-4f5d-b03f-ee30abd3399b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050824 Aug 31 10:55:25.363916 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 85/172] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:55:25.574329 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:25.575264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:25.584513 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:25.585034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:25.585820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:25.586894 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:25.587316 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:25.587996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:25.820273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:25.832525 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9cfb7e99-196d-4fa9-bf95-402859f0b59e tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1313 microversion: 2.1 time: 0.262958 Aug 31 10:55:25.859534 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 88/173] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:25 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:25.996944 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:25.997847 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:26.007563 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:26.008182 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:26.008900 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:26.009746 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:26.010327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:26.010984 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:26.229114 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:26.237312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2052403e-bc31-4e7a-b51d-bb7dbf748e88 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.244943 Aug 31 10:55:26.250336 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 86/174] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:25 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:26.278506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:26.279009 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:26.285160 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:26.285666 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:26.286178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:26.286887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:26.287336 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:26.287753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:26.301721 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] HTTP exception thrown: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Request method failure captured: Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: DELETE /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 HTTP/1.1 Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3Xf23koeSBwOWlv34VcPMxQBga7RuiMBqC2VakSTNuPe4Dd-EPuxVOWLMnvfDSH2ECwhRiTMUCxshZ4JiSn185oWpu4Vt_GfTVmiCQ0AuxR3mnRBA9yp2nesTKfXII7_VcALk8ByCstR9wnYxEtKtVUUHd2b7k1t_8h-NPqBgwRNw Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 1aa7cb99f3b44a85b984b80ad08e17c5 Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:55:26.303435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1aa7cb99f3b44a85b984b80ad08e17c5"}]}] Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 1aa7cb99f3b44a85b984b80ad08e17c5 Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-DeleteServersTestJSON-2084064227-project Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: c31a0c08c7a249caadd609a3e772c1c2 Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-DeleteServersTestJSON-2084064227-project Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.304731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'c872949e-187f-4c56-a92e-46a8f341f1f8'} Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:55:26.305397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.306508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.307935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Returning 404 to user: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:55:26.307935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-957c079a-c780-4386-b519-3bce3b190417 tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 404 len: 111 microversion: 2.1 time: 0.030844 Aug 31 10:55:26.307935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 89/175] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:55:26 2022] DELETE /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 10:55:26.314446 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:26.315143 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] [instance: c872949e-187f-4c56-a92e-46a8f341f1f8] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:26.321278 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:26.321862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:26.322350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:26.323146 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:26.323561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:26.323999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:26.338439 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] HTTP exception thrown: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Request method failure captured: Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 HTTP/1.1 Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3Xf23koeSBwOWlv34VcPMxQBga7RuiMBqC2VakSTNuPe4Dd-EPuxVOWLMnvfDSH2ECwhRiTMUCxshZ4JiSn185oWpu4Vt_GfTVmiCQ0AuxR3mnRBA9yp2nesTKfXII7_VcALk8ByCstR9wnYxEtKtVUUHd2b7k1t_8h-NPqBgwRNw Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 1aa7cb99f3b44a85b984b80ad08e17c5 Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 10:55:26.344330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/1aa7cb99f3b44a85b984b80ad08e17c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/1aa7cb99f3b44a85b984b80ad08e17c5"}]}] Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 1aa7cb99f3b44a85b984b80ad08e17c5 Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-DeleteServersTestJSON-2084064227 Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-DeleteServersTestJSON-2084064227-project Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: c31a0c08c7a249caadd609a3e772c1c2 Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-DeleteServersTestJSON-2084064227-project Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.345612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'c872949e-187f-4c56-a92e-46a8f341f1f8'} Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:55:26.346298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. Aug 31 10:55:26.347312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:55:26.349642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] Returning 404 to user: Instance c872949e-187f-4c56-a92e-46a8f341f1f8 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:55:26.350551 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a1f13a4e-3cd2-41df-b4b7-c2379315461e tempest-DeleteServersTestJSON-2084064227 tempest-DeleteServersTestJSON-2084064227-project] 10.222.0.75 "GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8" status: 404 len: 111 microversion: 2.1 time: 0.040421 Aug 31 10:55:26.351214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 87/176] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:26 2022] GET /compute/v2.1/servers/c872949e-187f-4c56-a92e-46a8f341f1f8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:26.859577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:26.861046 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:26.873192 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:26.873683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:26.874198 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:26.874906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:26.875521 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:26.876093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:27.258660 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:27.260043 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:27.266655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:27.267353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:27.267743 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:27.268506 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:27.269163 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:27.269637 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:27.383056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:27.392395 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c0ded403-5319-4663-8924-566d80d3815f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1313 microversion: 2.1 time: 0.538303 Aug 31 10:55:27.393035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 90/177] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:26 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:27.576225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:27.586428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e5f347d1-c029-40d8-9851-e05fdce481ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.331662 Aug 31 10:55:27.587089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 88/178] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:27 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:28.421325 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:28.423038 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:28.431573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:28.432514 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:28.433010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:28.433819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:28.434331 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:28.434812 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:28.608660 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:28.609829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:28.618235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:28.618959 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:28.619544 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:28.620638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:28.621964 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:28.622557 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:28.773933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:28.798026 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f474eb97-e977-4f13-b0f8-249ec6257c48 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1313 microversion: 2.1 time: 0.386516 Aug 31 10:55:28.799180 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 91/179] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:28 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:28.976879 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:28.987968 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f115e05e-0504-41bf-b2de-f4b5719b6156 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.384303 Aug 31 10:55:28.988848 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 89/180] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:28 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:29.820326 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:29.821656 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:29.836482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:29.839769 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=6 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:29.841446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:29.841943 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:29.842612 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:29.850021 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:29.850721 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:29.851319 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:30.009612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:30.011442 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:30.043882 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:30.059391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:30.060090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:30.060818 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:30.066062 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:30.066701 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:30.067152 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:30.106398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:30.124127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b875b9f8-7432-4b31-8b7b-b3274eb72e89 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1313 microversion: 2.1 time: 0.307572 Aug 31 10:55:30.125530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 92/181] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:29 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:30.250358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:30.267212 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f5dd35ef-59cc-46cb-856e-09f04075e1f1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.262167 Aug 31 10:55:30.268412 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 90/182] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:30 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:31.075958 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-fc68701c-03fc-43e6-8a5d-093e508bf720 req-78aca8d9-edae-4e2f-866e-94d59d881ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaacfb17-5746-40d9-9c36-a01451d45f79", "name": "network-vif-plugged", "status": "completed", "tag": "cb442099-5824-431a-ba42-8409b540a812"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:31.090076 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-fc68701c-03fc-43e6-8a5d-093e508bf720 req-78aca8d9-edae-4e2f-866e-94d59d881ae6 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:31.090611 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-fc68701c-03fc-43e6-8a5d-093e508bf720 req-78aca8d9-edae-4e2f-866e-94d59d881ae6 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:31.091944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-fc68701c-03fc-43e6-8a5d-093e508bf720 req-78aca8d9-edae-4e2f-866e-94d59d881ae6 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:31.108889 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-fc68701c-03fc-43e6-8a5d-093e508bf720 req-78aca8d9-edae-4e2f-866e-94d59d881ae6 service nova] Creating event network-vif-plugged:cb442099-5824-431a-ba42-8409b540a812 for instance eaacfb17-5746-40d9-9c36-a01451d45f79 on hv-cinder-79578 Aug 31 10:55:31.117103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-fc68701c-03fc-43e6-8a5d-093e508bf720 req-78aca8d9-edae-4e2f-866e-94d59d881ae6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044755 Aug 31 10:55:31.117733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 93/183] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:55:31.149311 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:31.150648 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:31.160280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:31.164416 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:31.165025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:31.166136 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:31.166927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:31.167352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:31.289439 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:31.290791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:31.304575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:31.308959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:31.311055 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:31.313252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:31.314392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:31.316231 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:31.464594 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:31.475689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-231f256a-16f3-4bf2-b370-16f080728d10 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1313 microversion: 2.1 time: 0.331099 Aug 31 10:55:31.476474 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 91/184] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:31 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:31.583273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:31.592066 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e7490fda-facd-4f6f-95af-6a09d1ed5388 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.307096 Aug 31 10:55:31.592820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 94/185] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:31 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:32.499324 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:32.499937 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:32.508263 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:32.509165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:32.512831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:32.514466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:32.515127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:32.518267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:32.613110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:32.613940 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:32.620708 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:32.622218 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:32.622960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:32.623773 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:32.624907 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:32.625625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:33.082747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:33.092650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d493618e-cf5f-4a0c-84c3-a522e9daef9b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1313 microversion: 2.1 time: 0.597587 Aug 31 10:55:33.104460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 92/186] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:32 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:33.131144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:33.140518 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7f0ff481-cb98-421e-bce3-534fde458616 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.531745 Aug 31 10:55:33.141438 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 95/187] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:32 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:34.115528 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:34.116414 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:34.131731 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:34.132317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:34.132951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:34.133716 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:34.134425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:34.134920 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:34.176266 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:34.178392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:34.188062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:34.192524 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:34.193639 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:34.194604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:34.196984 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:34.200462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:34.524521 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:34.533714 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d6df93f0-b2f7-4c98-bacc-1142f478c2c3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1497 microversion: 2.1 time: 0.422448 Aug 31 10:55:34.534347 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 93/188] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:34 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1497 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:34.545964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:34.562130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-afb5edb3-5b20-4ad8-be42-5eacd3c81e4e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.403700 Aug 31 10:55:34.562702 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 96/189] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:34 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:35.162455 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:35.163162 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:35.172612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:35.174087 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:35.175185 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:35.176480 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:35.177080 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:35.177625 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:35.216690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:55:35.358235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b46efa89-f435-41d1-87a7-1af8fdbe87b8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "DELETE /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 204 len: 0 microversion: 2.1 time: 0.199874 Aug 31 10:55:35.371133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:35.371795 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:35.381761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 94/190] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:55:35 2022] DELETE /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:55:35.394217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:35.394637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:35.395082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:35.395805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:35.396261 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:35.396687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:35.470032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:35.584887 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:35.585650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:35.602990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:35.603707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:35.604304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:35.605178 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:35.605803 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:35.606375 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:35.691358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:35.701762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c9338494-f9e5-4f83-8dbd-58a6009e4704 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1503 microversion: 2.1 time: 0.335190 Aug 31 10:55:35.717320 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 97/191] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:35 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:35.838268 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:35.847216 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ceea7a6a-dc50-4830-a603-0a887931c315 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.267041 Aug 31 10:55:35.848427 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 95/192] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:35 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:36.724252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:36.726503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:36.737525 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:36.738953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:36.739592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:36.740770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:36.741436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:36.742321 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:36.870813 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:36.871556 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:36.886038 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:36.888090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:36.890350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:36.892083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:36.892672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:36.897321 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:36.939710 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:36.950916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7c02b0d5-e7fc-4b8c-8ede-680e3c419b50 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1503 microversion: 2.1 time: 0.231818 Aug 31 10:55:36.952069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 98/193] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:36 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:37.095617 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:37.099915 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:37.105724 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4bf38adb-48b6-4288-a145-0c33dbe90431 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.239717 Aug 31 10:55:37.107146 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 96/194] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:36 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:37.413477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b9ef35ef-9d2b-4ed0-a6ac-769273b4ac08 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'create', calling method: .version_select at 0x7f37a8e1c4c0>, body: {"keypair": {"name": "tempest-keypair-1078277396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUSP/s001myG01dFHSHo9BdXnvyzb6z71LPREx8yf1LOo21gAhYPvqJ6p7WmFvpTwGM0nJpSDt+phlcebN6K46d42nPXOm9ENXozMAxuGxO5Af/qAdr089/gDiXYOpFJw=="}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:37.427272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:37.440991 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-b9ef35ef-9d2b-4ed0-a6ac-769273b4ac08 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Getting quotas for project 81fc613102504ca1a7f12a1fceb2ed51. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:55:37.447199 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-b9ef35ef-9d2b-4ed0-a6ac-769273b4ac08 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Getting quotas for user 324325d907f244beb6862df4116f2c78 and project 81fc613102504ca1a7f12a1fceb2ed51. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:55:37.474271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b9ef35ef-9d2b-4ed0-a6ac-769273b4ac08 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.198777 Aug 31 10:55:37.474981 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 99/195] 10.222.0.75 () {62 vars in 1200 bytes} [Wed Aug 31 10:55:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 10:55:37.977125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:37.977824 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:37.991403 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:37.992092 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:37.992574 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:37.993268 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:37.993828 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:37.994224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:38.135105 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:38.136419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:38.147699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:38.148533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:38.149443 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:38.151744 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:38.152666 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:38.153460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:38.746585 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:38.762056 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fc5b1dfa-5745-4a16-872b-40a3d59f6634 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 200 len: 1503 microversion: 2.1 time: 0.792755 Aug 31 10:55:38.763338 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 97/196] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:37 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 1503 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:38.775517 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-3d87c8ee-0bc5-4261-907f-b7f68adbb434 req-7f009687-5975-4a40-a01d-0c3f25e64e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaacfb17-5746-40d9-9c36-a01451d45f79", "name": "network-vif-deleted", "tag": "cb442099-5824-431a-ba42-8409b540a812"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:38.787923 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:38.796113 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-3d87c8ee-0bc5-4261-907f-b7f68adbb434 req-7f009687-5975-4a40-a01d-0c3f25e64e9c service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:38.796600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-3d87c8ee-0bc5-4261-907f-b7f68adbb434 req-7f009687-5975-4a40-a01d-0c3f25e64e9c service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:38.797020 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-3d87c8ee-0bc5-4261-907f-b7f68adbb434 req-7f009687-5975-4a40-a01d-0c3f25e64e9c service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:38.797538 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4f15e146-15c6-4373-9634-e470e9668533 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.669770 Aug 31 10:55:38.798654 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 100/197] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:38 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:38.814562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-3d87c8ee-0bc5-4261-907f-b7f68adbb434 req-7f009687-5975-4a40-a01d-0c3f25e64e9c service nova] Creating event network-vif-deleted:cb442099-5824-431a-ba42-8409b540a812 for instance eaacfb17-5746-40d9-9c36-a01451d45f79 on hv-cinder-79578 Aug 31 10:55:38.830672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-3d87c8ee-0bc5-4261-907f-b7f68adbb434 req-7f009687-5975-4a40-a01d-0c3f25e64e9c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055085 Aug 31 10:55:38.831354 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 98/198] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:55:39.788137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:39.789036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: eaacfb17-5746-40d9-9c36-a01451d45f79] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:39.797391 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:39.797577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:39.797952 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:39.798655 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:39.799313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:39.799803 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:39.815217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] HTTP exception thrown: Instance eaacfb17-5746-40d9-9c36-a01451d45f79 could not be found. Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Request method failure captured: Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 HTTP/1.1 Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz4ULbTOehEH5f-ImiAFp5vOGCXQMEj0PsG8LjQ6SkCUdZ29SEe1wI0ipYwAeNJsUHWjDYWLxUCVWg4yEyHEIqf5VJrliQAvm0z6EwzMIBxDzG3kzgS4FYmKDy1dhfzTWK2pX1AnlZrfmGy9AHCWOx1ZEcIEPelA-oWEVg_9EMZjIrQ Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: c7fb12ca0da546dcbcff810209d6fc40 Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-VolumesActionsTest-562165148 Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:55:39.816926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c7fb12ca0da546dcbcff810209d6fc40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7fb12ca0da546dcbcff810209d6fc40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7fb12ca0da546dcbcff810209d6fc40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c7fb12ca0da546dcbcff810209d6fc40"}]}] Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-VolumesActionsTest-562165148 Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: c7fb12ca0da546dcbcff810209d6fc40 Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-VolumesActionsTest-562165148 Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-VolumesActionsTest-562165148-project Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: fc33c6252cf04fd984cdcfe3913e3dcc Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-VolumesActionsTest-562165148-project Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance eaacfb17-5746-40d9-9c36-a01451d45f79 could not be found. Aug 31 10:55:39.818307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'eaacfb17-5746-40d9-9c36-a01451d45f79'} Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaacfb17-5746-40d9-9c36-a01451d45f79 could not be found. Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:55:39.818992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaacfb17-5746-40d9-9c36-a01451d45f79 could not be found. Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaacfb17-5746-40d9-9c36-a01451d45f79 could not be found. Aug 31 10:55:39.820163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:55:39.821157 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Returning 404 to user: Instance eaacfb17-5746-40d9-9c36-a01451d45f79 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:55:39.821157 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ecd8bfb0-f4da-486f-a937-e89b727dcc3d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79" status: 404 len: 111 microversion: 2.1 time: 0.035676 Aug 31 10:55:39.821157 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 101/199] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:39 2022] GET /compute/v2.1/servers/eaacfb17-5746-40d9-9c36-a01451d45f79 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:39.823139 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:39.823719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:39.831793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:39.832556 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:39.832985 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:39.833678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:39.834186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:39.834605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:39.969631 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1694370707", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "networks": [{"uuid": "1d1650f7-b587-4bdd-9b6c-844e03dbdc21"}]}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:40.054476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] validate_networks() for [('1d1650f7-b587-4bdd-9b6c-844e03dbdc21', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:55:40.064885 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:40.074583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c2c72d6c-c8e7-4541-a4a0-18fc7109ba03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.258693 Aug 31 10:55:40.083437 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 99/200] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:39 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:40.128343 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1752496488", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d5dea1a-cf96-44c4-b9f9-6117beb9295e"}], "security_groups": [{"name": "tempest-securitygroup--2057091481"}], "key_name": "tempest-keypair-1078277396", "user_data": "}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:40.272839 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.network.neutron [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] validate_networks() for [('8d5dea1a-cf96-44c4-b9f9-6117beb9295e', None, None, None, None, None)] {{(pid=120481) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:55:40.611707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:40.619130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:55:40.620015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:55:40.620602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:55:40.621241 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:55:40.621867 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:55:40.631862 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:40.632675 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:40.633129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:40.633886 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:40.634496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:40.634920 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:40.652108 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Getting quotas for project c7fb12ca0da546dcbcff810209d6fc40. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:55:40.659758 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Getting quotas for user fc33c6252cf04fd984cdcfe3913e3dcc and project c7fb12ca0da546dcbcff810209d6fc40. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:55:40.674429 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:55:40.677148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:55:40.744727 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-49512eee-9241-4bd0-9309-83f8ec2ffd34 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779398 Aug 31 10:55:40.753004 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 102/201] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:55:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:55:40.763281 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2df685dd-0660-4df3-898e-1b98ec446342 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:40.764251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2df685dd-0660-4df3-898e-1b98ec446342 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:40.877040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2df685dd-0660-4df3-898e-1b98ec446342 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:40.892156 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2df685dd-0660-4df3-898e-1b98ec446342 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1214 microversion: 2.1 time: 0.137479 Aug 31 10:55:40.893269 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 103/202] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:40 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:40.934625 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Flavor limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:55:40.936206 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Image limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:55:40.936971 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Flavor pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:55:40.937590 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Image pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:55:40.938314 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:55:40.953095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:40.953979 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:40.956296 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:40.957425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:40.958156 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:40.958795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:40.984904 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Getting quotas for project 81fc613102504ca1a7f12a1fceb2ed51. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:55:40.990508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Getting quotas for user 324325d907f244beb6862df4116f2c78 and project 81fc613102504ca1a7f12a1fceb2ed51. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:55:41.005672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Going to run 1 instances... {{(pid=120481) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:55:41.008734 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120481) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:55:41.095549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e5f2fac4-422b-4ab3-b0ba-4a0681c9c0ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.972279 Aug 31 10:55:41.096645 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:41.096790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 100/203] 10.222.0.75 () {62 vars in 1188 bytes} [Wed Aug 31 10:55:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 10:55:41.097856 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:41.108975 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:41.111444 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:41.112218 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:41.114752 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:41.115392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:41.116286 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:41.116685 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2ebae6f1-4652-4639-9dbf-d6c265f2b119 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:41.118628 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2ebae6f1-4652-4639-9dbf-d6c265f2b119 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:41.214209 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2ebae6f1-4652-4639-9dbf-d6c265f2b119 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:41.234614 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2ebae6f1-4652-4639-9dbf-d6c265f2b119 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:41.255008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2ebae6f1-4652-4639-9dbf-d6c265f2b119 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:41.259225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2ebae6f1-4652-4639-9dbf-d6c265f2b119 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1282 microversion: 2.20 time: 0.155727 Aug 31 10:55:41.262596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 101/204] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:41 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:41.449533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:41.462792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c82e016a-3813-4f74-b9db-0684fb5505bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.370011 Aug 31 10:55:41.463986 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 104/205] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:41 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:41.921491 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:41.924043 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:41.940919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:41.941568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:41.942002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:41.945831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:41.947287 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:41.947287 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:42.043272 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:42.068356 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9e045e8b-7a4c-4471-b8c5-0a36d73d904f tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1266 microversion: 2.1 time: 0.157403 Aug 31 10:55:42.068950 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 102/206] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:41 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:42.287359 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:42.288201 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:42.295961 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:42.296544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:42.297057 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:42.297901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:42.298818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:42.299309 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:42.474038 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:42.486790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:42.487244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:42.487886 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:42.488211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:42.489348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6395bddc-a6b9-4df7-8963-45a1b0347b21 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1334 microversion: 2.20 time: 0.207998 Aug 31 10:55:42.493944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 105/207] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:42 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1334 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:42.494530 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:42.495010 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:42.495522 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:42.496395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:42.496885 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:42.497244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:42.660033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:42.669493 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bba6b86b-8dae-47d8-ae90-3c6adfde5a9d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.186672 Aug 31 10:55:42.670128 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 103/208] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:42 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:43.090035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:43.090652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:43.096995 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:43.097486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:43.097956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:43.098652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:43.099108 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:43.099594 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:43.172615 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:43.182911 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1b23d330-1d92-4f17-be6b-1bddbfa17bd6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1274 microversion: 2.1 time: 0.096860 Aug 31 10:55:43.183509 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 106/209] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:43 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:43.512441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:43.513047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:43.519396 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:43.519859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:43.520288 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:43.520976 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:43.521414 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:43.521864 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:43.586231 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:43.599414 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:43.601556 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:43.602712 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-937376bc-bd3e-4dcc-aeee-093226976dd5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1334 microversion: 2.20 time: 0.094174 Aug 31 10:55:43.603259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 104/210] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:43 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:43.697033 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:43.697572 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:43.704504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:43.704983 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:43.705405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:43.706133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:43.706575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:43.706991 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:43.849405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:43.857807 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-778788b6-f98b-4c7d-82f8-93ebe6aa71fb tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.166512 Aug 31 10:55:43.858410 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 107/211] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:43 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:44.204427 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:44.205052 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:44.211485 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:44.211965 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:44.212419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:44.213097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:44.213548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:44.214000 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:44.277207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:44.288765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a28ca5b1-b371-4f19-8fb3-f340e1282304 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1274 microversion: 2.1 time: 0.087960 Aug 31 10:55:44.289458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 105/212] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:44 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:44.629146 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:44.630199 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:44.640774 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:44.641576 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:44.642342 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:44.643472 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:44.644221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:44.644915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:44.710028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:44.719298 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:44.720744 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:44.721894 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-91fbb801-405d-4673-a49a-cbc071c46e0d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1334 microversion: 2.20 time: 0.099243 Aug 31 10:55:44.722456 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 108/213] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:44 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:44.881214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:44.881794 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:44.889138 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:44.889649 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:44.890142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:44.890878 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:44.891328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:44.891745 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:45.031892 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:45.040124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3fe4e68e-6483-4e01-91d6-c7d8fc04a423 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.164733 Aug 31 10:55:45.040691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 106/214] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:44 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:45.313557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:45.314625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:45.324749 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:45.325533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:45.326312 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:45.327356 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:45.328090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:45.328787 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:45.394431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:45.402580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e5f0cb58-59a0-4c79-8072-a79955885ae8 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1274 microversion: 2.1 time: 0.095733 Aug 31 10:55:45.403156 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 109/215] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:45 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:45.748103 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:45.749187 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:45.759289 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:45.759776 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:45.760207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:45.760899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:45.761352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:45.761799 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:45.822845 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:45.831045 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:45.832478 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:45.833575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3693df10-4790-478c-a6c0-d41e9f83a3e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1334 microversion: 2.20 time: 0.091977 Aug 31 10:55:45.834244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 107/216] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:45 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:46.062759 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:46.064121 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:46.070258 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:46.070927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:46.071514 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:46.072363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:46.072963 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:46.073373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:46.305147 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:46.314595 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4330cea9-3b48-4a18-b6d7-080e47e5301d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.256888 Aug 31 10:55:46.315213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 110/217] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:46 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:46.423163 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:46.423879 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:46.430782 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:46.431696 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:46.432435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:46.433170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:46.433689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:46.434132 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:46.509025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:46.516573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0e316217-a28c-4247-8336-93a5cab37dcd tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1272 microversion: 2.1 time: 0.097362 Aug 31 10:55:46.517140 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 108/218] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:46 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:46.856373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:46.857142 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:46.874071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:46.874638 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:46.875307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:46.876335 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:46.877107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:46.877710 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:46.955354 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:46.963740 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:46.965286 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:46.966504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-939f7afe-1f85-41c9-b07b-3c88e976098a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1340 microversion: 2.20 time: 0.114356 Aug 31 10:55:46.981459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 111/219] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:46 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1340 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:47.336991 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:47.337609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:47.344310 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:47.344799 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:47.345229 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:47.345974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:47.346525 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:47.346952 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:47.538694 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:47.539409 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:47.548490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:47.550477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:47.550997 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:47.551857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:47.552310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:47.552795 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:47.657478 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:47.665658 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-416834fd-2d8d-4b18-8889-e7973a62bcbd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.332545 Aug 31 10:55:47.666382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 109/220] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:47 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:47.917637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:47.925670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7605e182-bd3c-4258-b035-0d3662b26709 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1314 microversion: 2.1 time: 0.391602 Aug 31 10:55:47.926581 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 112/221] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:47 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:47.988720 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:47.989326 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:47.995664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:47.996164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:47.996591 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:47.997285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:47.997741 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:47.998182 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:48.293009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:48.301701 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:48.303119 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:48.304280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c84894a3-e17c-4bfc-9886-fc2cfb01c0fb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1340 microversion: 2.20 time: 0.319544 Aug 31 10:55:48.305044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 110/222] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:47 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1340 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:48.687592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:48.688222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:48.701304 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:48.701826 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:48.702441 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:48.703356 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:48.703966 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:48.704550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:48.728353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-9d5dc4f8-5753-4db8-9376-6b3bfa1f519a req-8b44dde5-d468-467c-8d10-20062f24a7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f20d30-de57-4cf1-a107-bc9abf222d8c", "tag": "2c87a4d8-cd3c-461d-9ac2-85f887416f26"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:48.746438 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-9d5dc4f8-5753-4db8-9376-6b3bfa1f519a req-8b44dde5-d468-467c-8d10-20062f24a7f9 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:48.747203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-9d5dc4f8-5753-4db8-9376-6b3bfa1f519a req-8b44dde5-d468-467c-8d10-20062f24a7f9 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:48.747627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-9d5dc4f8-5753-4db8-9376-6b3bfa1f519a req-8b44dde5-d468-467c-8d10-20062f24a7f9 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:48.775688 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-9d5dc4f8-5753-4db8-9376-6b3bfa1f519a req-8b44dde5-d468-467c-8d10-20062f24a7f9 service nova] Creating event network-changed:2c87a4d8-cd3c-461d-9ac2-85f887416f26 for instance e6f20d30-de57-4cf1-a107-bc9abf222d8c on hv-cinder-79578 Aug 31 10:55:48.788603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-9d5dc4f8-5753-4db8-9376-6b3bfa1f519a req-8b44dde5-d468-467c-8d10-20062f24a7f9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063928 Aug 31 10:55:48.789219 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 111/223] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:55:48.950066 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:48.950906 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:48.957821 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:48.958760 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:48.959428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:48.960330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:48.961002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:48.961621 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:49.010777 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:49.021443 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-47a85d3a-8590-4689-b19b-83d8eb9502c1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1521 microversion: 2.1 time: 0.337667 Aug 31 10:55:49.022615 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 113/224] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:48 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:49.327393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:49.328328 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:49.334887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:49.335530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:49.336195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:49.337163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:49.337986 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:49.338621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:49.445196 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:49.453479 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-17b44bd1-bf70-4320-b3a7-960cdb4676f6 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1314 microversion: 2.1 time: 0.509941 Aug 31 10:55:49.454567 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 112/225] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:48 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:49.549643 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:49.559398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:49.560855 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:49.561989 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a28a02a2-9d87-471a-a77a-d93c3daad722 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.238510 Aug 31 10:55:49.562834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 114/226] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:49 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:55:50.044672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:50.045353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:50.052545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:50.053038 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:50.053470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:50.054210 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:50.054664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:50.055085 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:50.321090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:50.333735 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e1aeb24f-e8c6-4931-b798-11fb4702625b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1501 microversion: 2.1 time: 0.292951 Aug 31 10:55:50.337176 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 113/227] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:50 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1501 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:50.360893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:50.361519 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:50.372796 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:50.374170 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:50.374710 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:50.375977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:50.376650 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:50.377077 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:50.474020 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:50.474898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:50.481294 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:50.481761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:50.482384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:50.483130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:50.483574 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:50.483993 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:50.601404 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:50.610074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c94d23c0-f1de-47c8-8b1c-7d8e2701b7a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1514 microversion: 2.1 time: 0.257172 Aug 31 10:55:50.610893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 115/228] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:50 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:50.616339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:50.617111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:50.623611 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:50.624075 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:50.624686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:50.625823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:50.626427 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:50.626993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:50.664135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:50.671391 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:50.676048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2cf1f3d3-a7cc-4a4c-8b0c-58e7a6451395 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1314 microversion: 2.1 time: 0.205541 Aug 31 10:55:50.692547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 114/229] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:50 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:50.893223 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:50.895469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=12 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:50.903762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:50.905291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:50.906438 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1afd7c7d-6e77-42af-b70a-b8f4a23c664b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.294387 Aug 31 10:55:50.907351 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 116/230] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:50 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:50.917172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-c99805e6-5f5c-4230-9f88-157a786b92f7 req-61117fa3-69ca-413c-b6b1-491ff301ad4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8fdb0f3-110c-4250-8dcc-e44426464c66", "tag": "acef88c9-adeb-44f3-9d0f-359b56141283"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:50.928675 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-c99805e6-5f5c-4230-9f88-157a786b92f7 req-61117fa3-69ca-413c-b6b1-491ff301ad4f service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:50.929267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-c99805e6-5f5c-4230-9f88-157a786b92f7 req-61117fa3-69ca-413c-b6b1-491ff301ad4f service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:50.931317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-c99805e6-5f5c-4230-9f88-157a786b92f7 req-61117fa3-69ca-413c-b6b1-491ff301ad4f service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:50.945945 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-c99805e6-5f5c-4230-9f88-157a786b92f7 req-61117fa3-69ca-413c-b6b1-491ff301ad4f service nova] Creating event network-changed:acef88c9-adeb-44f3-9d0f-359b56141283 for instance a8fdb0f3-110c-4250-8dcc-e44426464c66 on hv-cinder-79578 Aug 31 10:55:50.951744 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-c99805e6-5f5c-4230-9f88-157a786b92f7 req-61117fa3-69ca-413c-b6b1-491ff301ad4f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038760 Aug 31 10:55:50.952348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 115/231] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:55:51.699253 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:51.699859 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:51.706595 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:51.707070 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:51.707490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:51.708171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:51.708621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:51.709027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:51.727273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=100 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:51.842088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:51.850076 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-38f25738-09a7-4d77-9887-dd89f9eece22 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1314 microversion: 2.1 time: 0.154821 Aug 31 10:55:51.850644 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 117/232] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:51 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:51.933686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:51.941091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:51.943156 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:51.943931 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=8 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:51.956708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:51.956708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:51.956708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:51.956708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:51.957033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:51.957033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:52.095106 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:52.103923 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:52.105331 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:52.106818 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c346b63b-979e-4447-bd97-17b97100960f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.181718 Aug 31 10:55:52.107368 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 116/233] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:51 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:52.871755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:52.872403 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:52.879483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:52.879969 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:52.880400 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:52.881121 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:52.881577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:52.882034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:53.012609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:53.020403 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cce106cb-ad73-4249-b1ce-316dd5c04fee tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1314 microversion: 2.1 time: 0.152859 Aug 31 10:55:53.020976 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 118/234] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:52 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:53.135102 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:53.135696 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:53.142107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:53.142592 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:53.143027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:53.143722 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:53.144174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:53.144593 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:53.148996 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:53.279242 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:53.292693 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:53.294155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:53.295291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4dabe754-fd33-45b6-a374-e0573802d504 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.166073 Aug 31 10:55:53.295839 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 117/235] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:53 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:54.042332 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:54.043051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:54.050160 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:54.050829 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:54.051471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:54.052353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:54.052974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:54.053985 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:54.222643 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:54.244788 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-56efd365-3175-42a4-845d-2969959c314a tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1314 microversion: 2.1 time: 0.206733 Aug 31 10:55:54.250203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 119/236] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:54 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:54.319597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:54.320348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:54.329926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:54.330425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:54.330862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:54.331571 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:54.332057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:54.332481 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:54.530496 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:54.539025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:54.540594 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:54.541685 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-adae600e-55f3-4e00-af47-21bdb36c6eaa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.227522 Aug 31 10:55:54.542297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 118/237] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:54 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:55.270517 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:55.271219 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:55.278858 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:55.279347 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:55.279780 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:55.280519 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:55.280955 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:55.281390 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:55.308083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:55.310493 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:55.317681 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:55.318399 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:55.319202 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:55.320038 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:55.320595 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:55.321203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:55.344877 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lazy-loading 'flavor' on Instance uuid bb885a17-8f70-412f-9319-6f48380cdeac {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:55:55.421973 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-25c5a393-ad98-4720-b9f3-07604dedb856 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac/action" status: 200 len: 32 microversion: 2.1 time: 0.118889 Aug 31 10:55:55.422596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 119/238] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:55:55 2022] POST /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 10:55:55.432299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:55.433254 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:55.434118 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:55.440096 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1e261118-a284-435e-8617-6ce8dc43cc25 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1314 microversion: 2.1 time: 0.175664 Aug 31 10:55:55.440683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 120/239] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:55 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:55.443965 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:55.444457 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:55.445305 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:55.446102 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:55.446638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:55.447056 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:55.567003 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:55.567621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:55.574178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:55.574643 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:55.575189 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:55.575865 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:55.576393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:55.576775 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:55.583376 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:55.597279 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-218ef6fb-110d-4526-aeb7-4aad6ce5a702 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.163353 Aug 31 10:55:55.597279 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 120/240] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:55 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:55.736153 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:55.745022 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:55.746907 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:55.748438 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e9dafc90-b29e-4c03-bad8-659189ca5126 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.185996 Aug 31 10:55:55.755964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 121/241] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:55 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:55.832254 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-76fb85c2-49aa-4034-8bde-3398e973e81f req-c74cebad-4043-4900-803e-ede939a06417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f20d30-de57-4cf1-a107-bc9abf222d8c", "name": "network-vif-plugged", "status": "completed", "tag": "2c87a4d8-cd3c-461d-9ac2-85f887416f26"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:55:55.852369 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-76fb85c2-49aa-4034-8bde-3398e973e81f req-c74cebad-4043-4900-803e-ede939a06417 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:55.852963 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-76fb85c2-49aa-4034-8bde-3398e973e81f req-c74cebad-4043-4900-803e-ede939a06417 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:55.853540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-76fb85c2-49aa-4034-8bde-3398e973e81f req-c74cebad-4043-4900-803e-ede939a06417 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:55.877334 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-76fb85c2-49aa-4034-8bde-3398e973e81f req-c74cebad-4043-4900-803e-ede939a06417 service nova] Creating event network-vif-plugged:2c87a4d8-cd3c-461d-9ac2-85f887416f26 for instance e6f20d30-de57-4cf1-a107-bc9abf222d8c on hv-cinder-79578 Aug 31 10:55:55.891571 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-76fb85c2-49aa-4034-8bde-3398e973e81f req-c74cebad-4043-4900-803e-ede939a06417 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064448 Aug 31 10:55:55.892439 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 121/242] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:55:56.464382 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:56.466341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:56.475832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:56.477280 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:56.478281 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:56.493210 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:56.494550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:56.494902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:56.613285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:56.614026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:56.620934 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:56.621459 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:56.621883 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:56.622767 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:56.623217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:56.623635 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:56.843558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:56.855426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-483dffbf-f090-4c57-9bc4-09584bebaf7b tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1314 microversion: 2.1 time: 0.397884 Aug 31 10:55:56.856013 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 122/243] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:56 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:56.860672 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:56.861547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:56.867477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:56.868023 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:56.868576 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:56.869318 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:56.869779 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:56.870265 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:56.871965 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:56.879851 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0059fa08-fc5c-4bb8-bd9b-b38075d6a825 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.270776 Aug 31 10:55:56.893118 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 122/244] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:56 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:57.059292 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:57.067919 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:57.069879 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:57.071077 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-25cc2316-9109-46bc-89a8-571ad85ec412 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.214124 Aug 31 10:55:57.072008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 123/245] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:56 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:57.876227 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:57.876861 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:57.888529 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:57.889343 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:57.889974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:57.890859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:57.891316 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:57.891742 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:57.903628 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:57.905001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:57.913479 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:57.914076 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:57.914575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:57.915606 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:57.916128 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:57.916636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:58.092576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:58.098254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:58.107580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-17306d3d-e127-454f-a9f4-650314b94f70 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.210998 Aug 31 10:55:58.108166 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 124/246] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:57 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:58.113048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:58.113930 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:58.120376 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:58.121879 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8419eb8e-2016-4333-aaa2-e7ed266d659d tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1314 microversion: 2.1 time: 0.249334 Aug 31 10:55:58.122146 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:58.122534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 123/247] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:57 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:58.122723 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:58.123634 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:58.124287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:58.124716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:58.262066 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:58.270370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:58.271799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:58.272909 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c490ceda-caa2-4552-beba-7e1caa39824d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.163465 Aug 31 10:55:58.273476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 125/248] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:58 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:55:59.128585 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:59.129185 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:59.135623 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:59.136100 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:59.136531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:59.137283 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:59.137993 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:59.138412 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:59.142830 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:59.143519 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:59.150139 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:59.150692 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:59.151158 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:59.151842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:59.152284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:59.152698 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:59.346000 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:59.348805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:59.354014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bd46eb5a-c15e-45f8-a04f-2ad5486ada1b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.229380 Aug 31 10:55:59.354554 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 124/249] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:59 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:55:59.360144 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:55:59.360669 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3ac5aa4e-7fd1-4c53-b993-5aede84ce658 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1499 microversion: 2.1 time: 0.221768 Aug 31 10:55:59.360776 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:55:59.361413 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 126/250] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:55:59 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1499 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:55:59.366889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:59.367404 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:59.367823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:59.368579 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:55:59.369285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:55:59.369640 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:55:59.506366 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:59.514857 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:59.516299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:55:59.517401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fdceadfd-974a-4b4c-a350-6a4a3e19334d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.161602 Aug 31 10:55:59.518002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 125/251] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:55:59 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:56:00.376502 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:00.377115 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:00.383499 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:00.384045 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:00.384469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:00.385183 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:00.385644 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:00.386062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:00.536204 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:00.540526 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:00.541246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:00.544993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d162fef3-0b31-42de-a04a-273ef5c33b03 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.172383 Aug 31 10:56:00.546014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 127/252] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:00 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:00.560257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:00.560739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:00.561172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:00.561924 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:00.562377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:00.562797 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:00.700863 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:00.709131 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:00.710624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:00.711763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d595ba1a-ab67-467f-bc63-8b5167d2840a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.175881 Aug 31 10:56:00.712546 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 126/253] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:56:00 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:56:01.567220 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:01.567832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:01.580698 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:01.581250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:01.581608 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:01.582324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:01.583011 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:01.583607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:01.730802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:01.733381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:01.734001 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:01.739255 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7f42486f-5efe-4aa0-9bc3-feb6ac97a9e4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.176861 Aug 31 10:56:01.739823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 128/254] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:01 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:01.740019 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:01.740318 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:01.740743 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:01.741421 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:01.741884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:01.742297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:01.892802 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:01.901293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:01.902742 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:01.903833 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bfa20a0f-4ea0-4689-b9b5-7cb71d898fbb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.174253 Aug 31 10:56:01.904358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 127/255] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:56:01 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:56:02.362040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-05c1d00f-7a7d-405d-a9b5-19f97ef60fa0 req-21128da3-849d-4da5-897e-86e89c8d8eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fdb0f3-110c-4250-8dcc-e44426464c66", "name": "network-vif-plugged", "status": "completed", "tag": "acef88c9-adeb-44f3-9d0f-359b56141283"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:02.372656 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-05c1d00f-7a7d-405d-a9b5-19f97ef60fa0 req-21128da3-849d-4da5-897e-86e89c8d8eaf service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:02.373233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-05c1d00f-7a7d-405d-a9b5-19f97ef60fa0 req-21128da3-849d-4da5-897e-86e89c8d8eaf service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:02.373699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-05c1d00f-7a7d-405d-a9b5-19f97ef60fa0 req-21128da3-849d-4da5-897e-86e89c8d8eaf service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:02.387888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-05c1d00f-7a7d-405d-a9b5-19f97ef60fa0 req-21128da3-849d-4da5-897e-86e89c8d8eaf service nova] Creating event network-vif-plugged:acef88c9-adeb-44f3-9d0f-359b56141283 for instance a8fdb0f3-110c-4250-8dcc-e44426464c66 on hv-cinder-79578 Aug 31 10:56:02.394730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-05c1d00f-7a7d-405d-a9b5-19f97ef60fa0 req-21128da3-849d-4da5-897e-86e89c8d8eaf service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036462 Aug 31 10:56:02.395346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 129/256] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:02.756983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:02.758910 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:02.760407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:02.761102 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:02.767224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:02.768369 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:02.768887 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:02.769518 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:02.769715 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:02.770269 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:02.770501 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:02.770824 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:02.771254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:02.772096 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:02.772753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:02.773324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:02.805248 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:56:02.912911 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-421037e2-da8a-4ba4-bab2-7641990eabca tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 204 len: 0 microversion: 2.1 time: 0.161520 Aug 31 10:56:02.913480 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 128/257] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:56:02 2022] DELETE /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:56:02.923379 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:02.924398 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:02.933049 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:02.933670 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:02.934307 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:02.935206 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:02.935838 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:02.936286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:02.942697 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:02.950496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7a46f113-9dae-4c1f-9656-6d2cdb1ddcdf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.194361 Aug 31 10:56:02.951257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 130/258] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:02 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:02.955939 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:02.956774 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:02.966951 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:02.967444 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:02.967874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:02.968575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:02.969091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:02.969516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:03.130466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:03.141653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3f042974-cec8-40a9-9f1c-184dc39eb0be tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1505 microversion: 2.1 time: 0.223201 Aug 31 10:56:03.142487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 129/259] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:02 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:03.158488 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:03.168896 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:03.170406 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:03.171539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a0303ff8-1445-4f4f-8de4-d72a43d3fa06 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.219224 Aug 31 10:56:03.172098 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 131/260] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:56:02 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:56:03.971917 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:03.972513 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:03.978707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:03.979190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:03.979609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:03.980293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:03.980745 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:03.981184 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:04.120663 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:04.124201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:04.129375 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2e406cb6-9a46-4530-81a7-c816857ebac1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.161322 Aug 31 10:56:04.129980 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 130/261] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:03 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:04.162918 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:04.163500 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:04.171886 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:04.172367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:04.172784 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:04.173475 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:04.173965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:04.174629 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:04.198473 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:04.199148 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:04.206655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:04.207131 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:04.207554 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:04.208431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:04.208877 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:04.209286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:04.413553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:04.422398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3f4d0148-f027-44b6-9377-6dbf3354be98 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1505 microversion: 2.1 time: 0.263304 Aug 31 10:56:04.423127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 132/262] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:04 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:04.459172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:04.469359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:04.471350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:04.473205 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6146cd0a-aeda-4c23-9d0c-5a84ef6b0c33 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1408 microversion: 2.20 time: 0.279725 Aug 31 10:56:04.474157 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 131/263] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:56:04 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:56:05.151130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:05.151738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:05.159741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:05.160226 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:05.160656 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:05.161358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:05.161857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:05.162250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:05.339088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:05.347296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-93ae7a76-ceb2-48b1-885d-b3779ee7ede7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.200283 Aug 31 10:56:05.347928 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 133/264] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:05 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:05.445963 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:05.446611 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:05.453341 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:05.454405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:05.455073 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:05.455945 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:05.456549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:05.457157 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:05.497166 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:05.497927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:05.504666 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:05.505243 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:05.506190 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:05.507307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:05.507987 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:05.509088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:05.804642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:05.811327 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:05.814964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=100 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:05.821874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:05.823622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:05.825532 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9d3b942b-2889-424a-8915-269a24c990ab tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1599 microversion: 2.20 time: 0.332800 Aug 31 10:56:05.825835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-16cf5e8d-27c1-48d1-b39a-918e5b4bbca3 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1505 microversion: 2.1 time: 0.381796 Aug 31 10:56:05.827411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 134/265] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:56:05 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1599 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:56:05.833734 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 132/266] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:05 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:05.865620 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c62de204-f921-46ee-91d1-a32a0e32edd1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:05.866222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c62de204-f921-46ee-91d1-a32a0e32edd1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:05.876096 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c62de204-f921-46ee-91d1-a32a0e32edd1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:05.876596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c62de204-f921-46ee-91d1-a32a0e32edd1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:05.877382 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c62de204-f921-46ee-91d1-a32a0e32edd1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:05.878131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c62de204-f921-46ee-91d1-a32a0e32edd1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:05.878580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c62de204-f921-46ee-91d1-a32a0e32edd1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:05.878996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c62de204-f921-46ee-91d1-a32a0e32edd1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:06.008227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c62de204-f921-46ee-91d1-a32a0e32edd1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146523 Aug 31 10:56:06.008857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 135/267] 10.222.0.75 () {60 vars in 1316 bytes} [Wed Aug 31 10:56:05 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:56:06.135833 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-943028e7-f763-4927-a320-57124feec409 req-15109b14-3a71-42d7-a995-905e084011b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f20d30-de57-4cf1-a107-bc9abf222d8c", "name": "network-vif-deleted", "tag": "2c87a4d8-cd3c-461d-9ac2-85f887416f26"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:06.145690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-943028e7-f763-4927-a320-57124feec409 req-15109b14-3a71-42d7-a995-905e084011b0 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:06.149077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-943028e7-f763-4927-a320-57124feec409 req-15109b14-3a71-42d7-a995-905e084011b0 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:06.149665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-943028e7-f763-4927-a320-57124feec409 req-15109b14-3a71-42d7-a995-905e084011b0 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:06.162978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-943028e7-f763-4927-a320-57124feec409 req-15109b14-3a71-42d7-a995-905e084011b0 service nova] Creating event network-vif-deleted:2c87a4d8-cd3c-461d-9ac2-85f887416f26 for instance e6f20d30-de57-4cf1-a107-bc9abf222d8c on hv-cinder-79578 Aug 31 10:56:06.168438 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-943028e7-f763-4927-a320-57124feec409 req-15109b14-3a71-42d7-a995-905e084011b0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036249 Aug 31 10:56:06.169041 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 133/268] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:06.369082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:06.370191 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:06.371562 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:06.377093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:06.377588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:06.378121 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:06.378976 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:06.379331 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:06.379728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:06.528844 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:06.537468 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cbd470e2-1662-4f76-b04e-a09d60b19619 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.172918 Aug 31 10:56:06.538404 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 136/269] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:06 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:06.864659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:06.866997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:06.878352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:06.880494 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:06.880979 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:06.882762 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:06.884926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:06.885650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:07.101364 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:07.102237 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:07.103064 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:07.103747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lazy-loading 'fault' on Instance uuid e6f20d30-de57-4cf1-a107-bc9abf222d8c {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:56:07.212215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc33c6252cf04fd984cdcfe3913e3dcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7fb12ca0da546dcbcff810209d6fc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:07.227942 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bc9800dc-2959-4afa-a755-489c8ebaccde tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 200 len: 1304 microversion: 2.1 time: 0.368740 Aug 31 10:56:07.229247 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 134/270] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:06 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 1304 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:07.559589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:07.560238 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:07.567237 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:07.567990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:07.568622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:07.569501 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:07.570149 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:07.570729 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:07.667829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-922b9f9d-cbcc-48bf-b62d-019174d14eee req-c3042f0f-a3b8-4fed-87ec-601697cf2994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8fdb0f3-110c-4250-8dcc-e44426464c66", "tag": "acef88c9-adeb-44f3-9d0f-359b56141283"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:07.684654 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-922b9f9d-cbcc-48bf-b62d-019174d14eee req-c3042f0f-a3b8-4fed-87ec-601697cf2994 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:07.685697 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-922b9f9d-cbcc-48bf-b62d-019174d14eee req-c3042f0f-a3b8-4fed-87ec-601697cf2994 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:07.686479 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-922b9f9d-cbcc-48bf-b62d-019174d14eee req-c3042f0f-a3b8-4fed-87ec-601697cf2994 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:07.702768 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-922b9f9d-cbcc-48bf-b62d-019174d14eee req-c3042f0f-a3b8-4fed-87ec-601697cf2994 service nova] Creating event network-changed:acef88c9-adeb-44f3-9d0f-359b56141283 for instance a8fdb0f3-110c-4250-8dcc-e44426464c66 on hv-cinder-79578 Aug 31 10:56:07.708927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-922b9f9d-cbcc-48bf-b62d-019174d14eee req-c3042f0f-a3b8-4fed-87ec-601697cf2994 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045808 Aug 31 10:56:07.711544 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 135/271] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:56:07.946259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:07.956839 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-03e948a0-8430-4223-a991-b327c0a78b13 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.401497 Aug 31 10:56:07.976050 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 137/272] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:07 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:08.251653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:08.252410 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] [instance: e6f20d30-de57-4cf1-a107-bc9abf222d8c] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:08.259212 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:08.261702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:08.262769 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:08.263852 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:08.264474 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:08.265055 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:08.291769 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] HTTP exception thrown: Instance e6f20d30-de57-4cf1-a107-bc9abf222d8c could not be found. Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Request method failure captured: Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c HTTP/1.1 Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz4ULbTOehEH5f-ImiAFp5vOGCXQMEj0PsG8LjQ6SkCUdZ29SEe1wI0ipYwAeNJsUHWjDYWLxUCVWg4yEyHEIqf5VJrliQAvm0z6EwzMIBxDzG3kzgS4FYmKDy1dhfzTWK2pX1AnlZrfmGy9AHCWOx1ZEcIEPelA-oWEVg_9EMZjIrQ Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: c7fb12ca0da546dcbcff810209d6fc40 Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-VolumesActionsTest-562165148 Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 10:56:08.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_c7fb12ca0da546dcbcff810209d6fc40"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7fb12ca0da546dcbcff810209d6fc40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/c7fb12ca0da546dcbcff810209d6fc40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/c7fb12ca0da546dcbcff810209d6fc40"}]}] Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-VolumesActionsTest-562165148 Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: c7fb12ca0da546dcbcff810209d6fc40 Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-VolumesActionsTest-562165148 Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-VolumesActionsTest-562165148-project Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: fc33c6252cf04fd984cdcfe3913e3dcc Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-VolumesActionsTest-562165148-project Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance e6f20d30-de57-4cf1-a107-bc9abf222d8c could not be found. Aug 31 10:56:08.295531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'e6f20d30-de57-4cf1-a107-bc9abf222d8c'} Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f20d30-de57-4cf1-a107-bc9abf222d8c could not be found. Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:56:08.296428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f20d30-de57-4cf1-a107-bc9abf222d8c could not be found. Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f20d30-de57-4cf1-a107-bc9abf222d8c could not be found. Aug 31 10:56:08.297804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:56:08.299767 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] Returning 404 to user: Instance e6f20d30-de57-4cf1-a107-bc9abf222d8c could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:56:08.300774 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bb349173-3f6b-4503-8849-b24ce468ae12 tempest-VolumesActionsTest-562165148 tempest-VolumesActionsTest-562165148-project] 10.222.0.75 "GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c" status: 404 len: 111 microversion: 2.1 time: 0.053740 Aug 31 10:56:08.305238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 136/273] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:08 2022] GET /compute/v2.1/servers/e6f20d30-de57-4cf1-a107-bc9abf222d8c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:56:08.983528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:08.984080 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:08.991287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:08.992017 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:08.992634 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:08.993587 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:08.994610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:08.995198 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:09.630481 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:09.646713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b42753da-a815-43e7-ab82-b7e9c0c2f676 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.667016 Aug 31 10:56:09.647550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 138/274] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:08 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:09.656839 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5a638e07-e5e1-4a59-9f32-1b13e53e1846 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:09.658182 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5a638e07-e5e1-4a59-9f32-1b13e53e1846 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:09.671707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a638e07-e5e1-4a59-9f32-1b13e53e1846 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:09.673552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a638e07-e5e1-4a59-9f32-1b13e53e1846 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:09.674453 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a638e07-e5e1-4a59-9f32-1b13e53e1846 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:09.675198 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a638e07-e5e1-4a59-9f32-1b13e53e1846 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:09.675687 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a638e07-e5e1-4a59-9f32-1b13e53e1846 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:09.678073 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a638e07-e5e1-4a59-9f32-1b13e53e1846 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:09.778073 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5a638e07-e5e1-4a59-9f32-1b13e53e1846 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/ips" status: 200 len: 146 microversion: 2.1 time: 0.127265 Aug 31 10:56:09.780485 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 137/275] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 10:56:09 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/ips => generated 146 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:10.671990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:10.673127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:10.695085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:10.695688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:10.696508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:10.697536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:10.698368 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:10.699026 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:10.925027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:10.933627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-90b51d75-adeb-4051-8687-cf0493fac6d7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.266023 Aug 31 10:56:10.946506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 139/276] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:10 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:11.959065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:11.960300 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:11.962909 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:11.968268 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:11.968820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:11.969321 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:11.970151 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:11.970673 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:11.971299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:12.139835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:12.151570 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-aedddbb0-5d44-4b0d-b2f3-d8d484d3e785 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.199269 Aug 31 10:56:12.152329 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 138/277] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:11 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:13.179946 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:13.182214 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:13.194108 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:13.194713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:13.195083 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:13.196020 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:13.197639 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:13.198487 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:13.446385 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:13.471855 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-efef2ad7-44dc-4f39-9088-bd8b7f7a26e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.299146 Aug 31 10:56:13.476214 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 140/278] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:13 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:14.504137 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:14.505481 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:14.516722 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-05e2ccc6-56ab-4fe4-be6b-e7ec1536f9cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:14.517127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-05e2ccc6-56ab-4fe4-be6b-e7ec1536f9cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:14.518342 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:14.518847 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:14.519297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:14.520000 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:14.520450 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:14.520869 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:14.525603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-05e2ccc6-56ab-4fe4-be6b-e7ec1536f9cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:14.526271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-05e2ccc6-56ab-4fe4-be6b-e7ec1536f9cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:14.527033 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-05e2ccc6-56ab-4fe4-be6b-e7ec1536f9cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:14.531594 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-05e2ccc6-56ab-4fe4-be6b-e7ec1536f9cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:14.532275 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-05e2ccc6-56ab-4fe4-be6b-e7ec1536f9cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:14.532855 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-05e2ccc6-56ab-4fe4-be6b-e7ec1536f9cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:14.570761 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-05e2ccc6-56ab-4fe4-be6b-e7ec1536f9cb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/ips" status: 200 len: 150 microversion: 2.1 time: 0.058115 Aug 31 10:56:14.572598 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 141/279] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 10:56:14 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/ips => generated 150 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:14.927235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:14.953054 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c0dd2f5a-19f2-4e76-9166-350e7cf03149 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.453255 Aug 31 10:56:14.953654 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 139/280] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:14 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:15.174400 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-539c0488-27b1-4826-852e-0beb924d3815 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "286ef2a2-aa57-4a09-b91b-2aef2782d8f9"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:15.183416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-539c0488-27b1-4826-852e-0beb924d3815 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:15.208437 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-539c0488-27b1-4826-852e-0beb924d3815 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:15.209160 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-539c0488-27b1-4826-852e-0beb924d3815 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:15.211684 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-539c0488-27b1-4826-852e-0beb924d3815 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:15.216347 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-539c0488-27b1-4826-852e-0beb924d3815 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:15.218381 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-539c0488-27b1-4826-852e-0beb924d3815 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:15.220446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-539c0488-27b1-4826-852e-0beb924d3815 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:15.833314 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-539c0488-27b1-4826-852e-0beb924d3815 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.672064 Aug 31 10:56:15.833983 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 142/281] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 10:56:15 2022] POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/os-volume_attachments => generated 194 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:15.976352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:15.976991 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:16.023220 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:16.023990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:16.025251 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:16.027706 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:16.028568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:16.029427 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:16.467637 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:16.481249 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c1c117b5-21e8-4d75-967a-a91c3fada545 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.510738 Aug 31 10:56:16.487292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 140/282] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:15 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:16.760165 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-75747ea0-0c84-4fda-93ca-029be622fc1a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f7962eb-6d8a-4106-8ec0-17728c136436"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:16.762731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-75747ea0-0c84-4fda-93ca-029be622fc1a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:16.799133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75747ea0-0c84-4fda-93ca-029be622fc1a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:16.799769 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75747ea0-0c84-4fda-93ca-029be622fc1a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:16.804159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75747ea0-0c84-4fda-93ca-029be622fc1a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:16.808732 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75747ea0-0c84-4fda-93ca-029be622fc1a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:16.809604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75747ea0-0c84-4fda-93ca-029be622fc1a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:16.812712 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75747ea0-0c84-4fda-93ca-029be622fc1a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:17.411415 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-75747ea0-0c84-4fda-93ca-029be622fc1a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655453 Aug 31 10:56:17.421195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 143/283] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 10:56:16 2022] POST /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:17.509897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:17.510696 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:17.527571 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:17.528402 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:17.529008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:17.530765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:17.531388 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:17.532025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:17.846721 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:17.862023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8759db4c-13a6-40b2-859b-f2349c28aace tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.357852 Aug 31 10:56:17.863235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 141/284] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:17 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:18.882995 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:18.883708 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:18.896412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:18.897213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:18.897351 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:18.898068 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:18.904342 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:18.905627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:19.113332 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:19.122904 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ba820555-bd62-44b4-a8c4-b86a41f56880 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.244035 Aug 31 10:56:19.136996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 144/285] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:18 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:20.143819 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:20.145663 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:20.155504 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:20.156304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:20.157376 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:20.158839 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:20.161669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:20.162381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:20.463571 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:20.475766 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3f64f4d3-bbfa-41cd-8063-8543fe8bd103 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.336523 Aug 31 10:56:20.480350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 142/286] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:20 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:21.509903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:21.510810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:21.523567 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:21.527180 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:21.527861 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:21.528807 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:21.529432 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:21.530050 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:21.852431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:21.863654 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c88e4202-43c6-4199-9e24-bedd33b6aa48 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.358409 Aug 31 10:56:21.878567 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 145/287] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:21 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:22.887316 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:22.888034 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:22.898813 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:22.899376 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:22.899952 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:22.900683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:22.901135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:22.901549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:23.237146 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:23.247291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5f88d80e-41e6-41bd-b77f-48b45808e4ad tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.364154 Aug 31 10:56:23.259309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 143/288] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:22 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:24.284320 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:24.284943 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:24.297424 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:24.303074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:24.303621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:24.304366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:24.314526 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:24.314974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:25.135638 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:25.149702 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cca276ce-03ad-4f1e-a06a-6b8d2e348113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.873356 Aug 31 10:56:25.178237 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 146/289] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:24 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:26.191830 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:26.192515 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:26.228713 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:26.232491 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:26.233333 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:26.235088 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:26.238092 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:26.240557 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:26.331898 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-32b0a5e9-7198-4ba9-9524-00a768b3be8e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:26.364088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-32b0a5e9-7198-4ba9-9524-00a768b3be8e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:26.364633 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-32b0a5e9-7198-4ba9-9524-00a768b3be8e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:26.365086 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-32b0a5e9-7198-4ba9-9524-00a768b3be8e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:26.527858 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-32b0a5e9-7198-4ba9-9524-00a768b3be8e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Going to try to stop instance {{(pid=120482) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 10:56:26.655133 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:26.664934 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-32b0a5e9-7198-4ba9-9524-00a768b3be8e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/action" status: 202 len: 0 microversion: 2.1 time: 0.348648 Aug 31 10:56:26.666405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 147/290] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:56:26 2022] POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:56:26.673296 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b82e141d-4029-4d3b-843c-16c977a58c7e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.485660 Aug 31 10:56:26.676965 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 144/291] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:26 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:26.685603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:26.686966 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:26.708393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:26.709052 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:26.710311 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:26.711665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:26.716105 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:26.716567 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:26.765262 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:27.132193 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:27.147866 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-554162fb-2df4-491e-bfff-789596012196 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.477019 Aug 31 10:56:27.148551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 148/292] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:26 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:27.175023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1494045757", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:27.697479 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:27.698124 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:27.726984 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:27.727477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:27.728004 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:27.728959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:27.729393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:27.729851 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:28.005035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:28.023103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9cdfdffd-6ce3-4a66-aac5-182932a6c0e3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.330428 Aug 31 10:56:28.023915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 149/293] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:27 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:28.178828 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:28.179870 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:28.195999 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:28.197532 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:28.198466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:28.204663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:28.205430 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:28.206114 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:28.522908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:28.541524 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-adec6f3e-41d5-4cb0-b9f4-1085afc3382e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.372620 Aug 31 10:56:28.542851 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 150/294] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:28 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:29.045912 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:29.047045 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:29.059000 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:29.071947 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:29.072546 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:29.074386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:29.074956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:29.075547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:29.441477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:29.468339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d9da9380-26f9-4874-8bc3-cbc798f29e71 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.422005 Aug 31 10:56:29.473183 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 151/295] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:29 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:29.566427 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:29.567369 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:29.583227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:29.583869 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:29.586667 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:29.587642 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:29.591398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:29.592106 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:29.831824 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:29.842802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-81dd7da6-70bd-4fa7-ae75-a2b6b94d17b9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.281107 Aug 31 10:56:29.843875 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 152/296] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:29 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:30.534184 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:30.534869 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:30.549605 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:30.550207 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:30.550718 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:30.551512 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:30.552039 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:30.552535 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:30.733636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:30.745110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ac5c370c-361e-4b36-88ba-fe01b619d7ff tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.252865 Aug 31 10:56:30.746028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 153/297] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:30 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:30.866360 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:30.867154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:30.880372 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:30.881542 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:30.882245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:30.883256 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:30.883986 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:30.884632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:31.095980 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:31.114578 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-60e3f494-12ac-42c8-90f6-a9341660188a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.252460 Aug 31 10:56:31.129244 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 154/298] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:30 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:31.767719 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:31.769250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:31.795078 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:31.795892 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:31.797118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:31.798103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:31.798584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:31.799023 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:32.032845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:32.044633 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-adf240d0-1682-416f-b055-75279bd87189 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.281513 Aug 31 10:56:32.063331 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 155/299] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:31 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:32.137081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:32.137719 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:32.161380 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:32.161908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:32.162579 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:32.163335 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:32.163817 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:32.164247 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:32.379421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:32.393647 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-44c4d970-18be-4c03-9172-c5b721a24855 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.260620 Aug 31 10:56:32.394735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 156/300] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:32 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:33.071129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:33.072034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:33.092445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:33.093094 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:33.093619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:33.098651 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:33.099626 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:33.100540 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:33.375859 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:33.463603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5a4af3cd-60d8-45d3-897f-000446592222 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.361164 Aug 31 10:56:33.489911 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 157/301] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:33 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:33.497239 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:33.498609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:33.507143 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:33.508065 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:33.509142 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:33.510262 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:33.511027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:33.511706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:33.736046 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:33.751388 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-10dba1ac-694e-469b-9ed0-493655c7060b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.258583 Aug 31 10:56:33.752419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 158/302] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:33 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:33.757687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-76b0784a-b198-4bef-b944-4f0e95135480 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: .version_select at 0x7f37aa191040>, body: {"keypair": {"name": "tempest-keypair-1125531537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN6bwVGQ0eCuRNcPy4O5Tl3uKuiIV0+7OFm/dPaSe7R6sFjbycAG/rA/QeTQurRWN0UrIO4TyBxdgpruv419fNozOxkHUUAVausW/3o1AMfR97/Y6jAAHMCPUmQnsi16Q=="}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:33.796754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-76b0784a-b198-4bef-b944-4f0e95135480 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:56:33.801002 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-76b0784a-b198-4bef-b944-4f0e95135480 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for user 73f1b9e32ad3493284c5df45afd042fa and project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:56:33.851584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-76b0784a-b198-4bef-b944-4f0e95135480 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097862 Aug 31 10:56:33.852490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 159/303] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 10:56:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:34.493908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:34.494722 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:34.503811 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:34.504602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:34.505396 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:34.506510 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:34.507709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:34.509125 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:34.659226 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.network.neutron [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] validate_networks() for None {{(pid=120481) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:56:34.775504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:34.788695 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-73e01b68-66cb-4fdc-9a41-777b127ba509 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.299681 Aug 31 10:56:34.789682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 160/304] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:34 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:34.796049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-dc01b9f3-23f9-4706-ae62-234d83659310 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Action: 'create', calling method: .version_select at 0x7f37aa191700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-793035932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwNjmTgq+iLZREFHDXRp3vsRMH0lb3dGmh4nUDm5j+ZXsW8uP5QRwBDMH/No3Vubdpm3hc5hPN1tRC8/KmGFPNcdMKkKHotjqUB+xVkHmEMa4xqvIGdIuFZWg4yGJ08lA=="}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:34.851534 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-dc01b9f3-23f9-4706-ae62-234d83659310 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Getting quotas for project 6edee50c9ca84b43b58209073abb6642. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:56:34.860034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-dc01b9f3-23f9-4706-ae62-234d83659310 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Getting quotas for user 1847928c4aa04730a897f38ac67d7071 and project 6edee50c9ca84b43b58209073abb6642. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:56:34.905420 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-dc01b9f3-23f9-4706-ae62-234d83659310 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.113830 Aug 31 10:56:34.906344 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 161/305] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 10:56:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:34.922213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:34.922832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:34.944498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:34.945295 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:34.945674 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:34.946751 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:34.947355 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:34.952188 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:35.321742 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Flavor limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:56:35.322498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Image limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:56:35.323338 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Flavor pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:56:35.323898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Image pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:56:35.324549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:56:35.328935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:35.342714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-70996e8f-903b-49f1-9fdc-ebd2d24dfa2c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.424407 Aug 31 10:56:35.353796 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 162/306] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:34 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:35.353796 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1670084984", "imageRef": "1415b3ee-979d-4487-b801-34f77baa9e85", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-793035932", "networks": [{"uuid": "68a02d2b-9ae9-42ec-8620-4e10f0c353f7"}]}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:35.375369 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:35.375866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:35.376655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:35.378003 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:35.378859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:35.379547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:35.408150 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=73 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:35.431484 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Getting quotas for project dec1e95f67cb4ec48c5741475828db91. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:56:35.439048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Getting quotas for user 9ca28332a4944d5a8d64085e4148b649 and project dec1e95f67cb4ec48c5741475828db91. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:56:35.454024 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] validate_networks() for [('68a02d2b-9ae9-42ec-8620-4e10f0c353f7', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:56:35.458770 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Going to run 1 instances... {{(pid=120481) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:56:35.462289 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120481) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:56:35.556925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bf661eb1-6b23-491f-bacf-341c4ae6f73a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.386463 Aug 31 10:56:35.564947 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 145/307] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:56:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 8395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:56:35.572062 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-09cb0bad-0e13-410b-b70b-48aee72047f5 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:35.573021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-09cb0bad-0e13-410b-b70b-48aee72047f5 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:35.678677 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-09cb0bad-0e13-410b-b70b-48aee72047f5 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:35.691573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-09cb0bad-0e13-410b-b70b-48aee72047f5 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1215 microversion: 2.1 time: 0.125121 Aug 31 10:56:35.693847 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 146/308] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:35 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:35.815314 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:35.816376 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:35.826012 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:35.832689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:35.834360 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:35.836554 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:35.837258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:35.837882 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:36.279592 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:36.298234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-deab25bc-0492-40ac-bb4f-e2794e0cc480 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.486194 Aug 31 10:56:36.313113 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 147/309] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:35 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:36.319407 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1190373241", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea0de259-9ec9-40ad-9450-e7dd0067411a"}], "security_groups": [{"name": "tempest-securitygroup--672736363"}], "key_name": "tempest-keypair-1125531537", "user_data": "}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:36.404002 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:56:36.404568 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:56:36.404877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:56:36.405468 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:56:36.405918 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:56:36.408249 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:36.423030 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:36.424043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:36.424936 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:36.426139 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:36.426768 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:36.427360 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:36.457138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Getting quotas for project 6edee50c9ca84b43b58209073abb6642. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:56:36.462130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Getting quotas for user 1847928c4aa04730a897f38ac67d7071 and project 6edee50c9ca84b43b58209073abb6642. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:56:36.477041 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:56:36.479854 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1415b3ee-979d-4487-b801-34f77baa9e85',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:56:36.547902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0125cb0c-c574-4ff2-817b-6b4900aa6eda tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202655 Aug 31 10:56:36.548980 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 163/310] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:56:36.561956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:36.563106 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:36.571163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:36.572091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:36.572739 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:36.574412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:36.574709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:36.575380 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:36.757152 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:36.768309 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6029fe20-2bfd-4528-b8dc-406c7cfd8f4e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.217326 Aug 31 10:56:36.769589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 164/311] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:36 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:36.776345 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-28331f5c-5307-4c06-ad61-349c2ac78028 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:36.777496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-28331f5c-5307-4c06-ad61-349c2ac78028 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:36.843559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-28331f5c-5307-4c06-ad61-349c2ac78028 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:36.851773 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-28331f5c-5307-4c06-ad61-349c2ac78028 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1258 microversion: 2.1 time: 0.080378 Aug 31 10:56:36.852329 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 165/312] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:36 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:36.857117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:36.857744 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:36.864773 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:36.865541 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:36.866183 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:36.867123 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:36.867734 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:36.868333 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:36.954970 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:36.970358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-75ee7473-dd82-4a05-9d57-b4a87b824fba tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1211 microversion: 2.1 time: 0.114729 Aug 31 10:56:36.971177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 166/313] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:36 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:37.321272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:37.322171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:37.329443 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.330331 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.330889 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:37.331866 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.332469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.333091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:37.483386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:37.498735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b1e8abe4-db5c-4e44-bce2-60823ed27fab tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.181291 Aug 31 10:56:37.499342 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 167/314] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:37 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:37.795543 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:37.796457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:37.803992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.804455 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.805023 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:37.805968 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.806739 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.807444 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:37.953514 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:37.962388 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=100 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:37.968753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f708dbeb-d7ee-47ee-9344-ae43fcea57e7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.179796 Aug 31 10:56:37.969553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 168/315] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:37 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:37.988988 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:37.989665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:37.996527 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.997051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.997503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:37.998427 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:37.999085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:37.999511 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:38.074128 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:38.082416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-82ecb74e-4b1f-411d-a8ba-5dbf262a1ce8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1310 microversion: 2.1 time: 0.111850 Aug 31 10:56:38.083188 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 169/316] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:37 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1310 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:38.094182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:38.094926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:38.116637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:38.119138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:38.121389 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:38.126725 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:38.127749 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:38.128544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:38.203431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:38.211930 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d3b56892-d5b3-4b17-a68b-71cf36a0118d tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1267 microversion: 2.1 time: 0.123911 Aug 31 10:56:38.212778 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 170/317] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:38 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1267 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:38.522175 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:38.522867 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:38.530087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:38.530895 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:38.531514 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:38.532668 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:38.533213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:38.533661 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.066114 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:39.074077 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-56f3cc9f-1997-4c03-a1ca-a688dd3755ed tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1500 microversion: 2.1 time: 0.556812 Aug 31 10:56:39.074939 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 171/318] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:38 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1500 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:39.086970 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:39.087996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:39.097164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.097861 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.098495 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.099508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.100267 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.101258 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.477886 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:39.495184 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-af76102b-276e-41fc-9450-da7196746fcd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.418859 Aug 31 10:56:39.509070 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 172/319] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:39 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:39.514894 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a6c882a-2bac-48a0-9dc4-1251a1d42f2f"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:39.518841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:39.526085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.527464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.528191 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.529162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.530215 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.531374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.558984 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] HTTP exception thrown: Cannot 'attach_volume' instance bb885a17-8f70-412f-9319-6f48380cdeac while it is in vm_state rescued Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Request method failure captured: Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: POST /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac/os-volume_attachments HTTP/1.1 Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 74 Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3bhecCROhg559l7k6U_enr0Hvh6lIA1bfD95Tam4VIDiIqYdoF7oCrVXCp1BhUt7gilM4vhdttkgI6BDDijC2mGNO8tfaQKHCjF2ZAj7_4FatiqrT1SoMiu_Q_DToTM8iektlE4E5SlylP897K-u16pRUV6d9X0fVtAb0wcS_Wql0 Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:56:39.561144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3aabb02cf14541f997b08fe0853acac0"}]}] Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 3dc4ac4ada004bbb942c36755f4a7cd1 Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {"volumeAttachment": {"volumeId": "5a6c882a-2bac-48a0-9dc4-1251a1d42f2f"}} Aug 31 10:56:39.562960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Cannot 'attach_volume' instance bb885a17-8f70-412f-9319-6f48380cdeac while it is in vm_state rescued Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'server_id': 'bb885a17-8f70-412f-9319-6f48380cdeac', 'body': {'volumeAttachment': {'volumeId': '5a6c882a-2bac-48a0-9dc4-1251a1d42f2f'}}} Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb885a17-8f70-412f-9319-6f48380cdeac in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:56:39.564185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bb885a17-8f70-412f-9319-6f48380cdeac while it is in vm_state rescued Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:56:39.570043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:56:39.571794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:56:39.571794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:56:39.571794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bb885a17-8f70-412f-9319-6f48380cdeac while it is in vm_state rescued Aug 31 10:56:39.571794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:56:39.571794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Returning 409 to user: Cannot 'attach_volume' instance bb885a17-8f70-412f-9319-6f48380cdeac while it is in vm_state rescued {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:56:39.571794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-af6f1f60-142d-4450-89f8-2975ce3452e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053072 Aug 31 10:56:39.571794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 173/320] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 10:56:39 2022] POST /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 10:56:39.572681 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:39.573365 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:39.580346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.580959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.581523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.582307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.582834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.583313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.727800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:39.736954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-fa94386e-c738-4d57-9aa1-937d8de9680e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1316 microversion: 2.1 time: 0.169745 Aug 31 10:56:39.738172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 174/321] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:39 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:39.743875 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:39.744911 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:39.752217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.753040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.753667 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.754849 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.755556 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.756288 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.865306 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:39.875328 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b6d1a564-d642-498a-8911-b986727f70bb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1273 microversion: 2.1 time: 0.135799 Aug 31 10:56:39.876607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 175/322] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:39 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:39.896714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b52fc189-ba4f-4c25-b2d6-8f961ac6d2e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:39.897595 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b52fc189-ba4f-4c25-b2d6-8f961ac6d2e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:39.905652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b52fc189-ba4f-4c25-b2d6-8f961ac6d2e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.907329 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b52fc189-ba4f-4c25-b2d6-8f961ac6d2e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.908137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b52fc189-ba4f-4c25-b2d6-8f961ac6d2e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:39.909129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b52fc189-ba4f-4c25-b2d6-8f961ac6d2e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:39.909954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b52fc189-ba4f-4c25-b2d6-8f961ac6d2e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:39.910788 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b52fc189-ba4f-4c25-b2d6-8f961ac6d2e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:40.005523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b52fc189-ba4f-4c25-b2d6-8f961ac6d2e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac/action" status: 202 len: 0 microversion: 2.1 time: 0.126989 Aug 31 10:56:40.009642 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 176/323] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:56:39 2022] POST /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:56:40.015999 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:40.016987 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:40.024316 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:40.024848 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:40.025809 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:40.026359 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:40.026917 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:40.027340 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:40.628175 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:40.641079 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-86519855-2200-46ac-b4a7-082e6892854b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.629602 Aug 31 10:56:40.642225 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 177/324] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:40 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:40.647008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:40.647810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:40.655848 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:40.657086 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:40.657086 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:40.657487 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:40.657920 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:40.659343 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:41.032252 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.network.neutron [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] validate_networks() for [('ea0de259-9ec9-40ad-9450-e7dd0067411a', None, None, None, None, None)] {{(pid=120481) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:56:41.245674 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:41.258273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-740381e2-13af-419e-a24a-943264cbcb9b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.614645 Aug 31 10:56:41.258831 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 178/325] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:40 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:41.263769 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:41.264333 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:41.274676 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:41.276171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:41.276870 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:41.277525 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:41.278101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:41.278566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:42.023722 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:42.034839 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-64ec2da4-29d9-41a4-9f46-15ac94ee507d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.774357 Aug 31 10:56:42.035771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 179/326] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:41 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:42.054266 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:42.055032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:42.066148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:42.066939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:42.069182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:42.069808 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:42.074140 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:42.074730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:42.075250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:42.370033 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:42.380374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2f50d62c-3b28-4b8d-a0a6-a4e7c1972cd9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.343059 Aug 31 10:56:42.394993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 180/327] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:42 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:42.400612 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:42.401508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:42.408687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:42.409751 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:42.410633 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:42.411887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:42.412519 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:42.413068 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:42.542304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Flavor limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:56:42.542718 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Image limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:56:42.543361 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Flavor pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:56:42.543925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Image pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:56:42.544498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:56:42.561501 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:42.562936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:42.563680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:42.565106 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:42.565730 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:42.566688 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:42.595075 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:56:42.605179 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:42.608762 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for user 73f1b9e32ad3493284c5df45afd042fa and project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:56:42.616998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c1175234-e054-4a4f-a9cb-099feb539239 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.220314 Aug 31 10:56:42.620433 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 181/328] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:42 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:42.627514 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:42.630349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Going to run 1 instances... {{(pid=120481) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:56:42.632978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120481) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:56:42.633845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:42.648746 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:42.649377 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:42.650216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:42.651442 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:42.651921 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:42.652516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:42.722160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7377161c-c52f-4b65-9a0c-410936ff7b81 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 6.407321 Aug 31 10:56:42.729664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 148/329] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:56:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 6416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:56:42.735253 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9c551510-5520-4a3e-a11a-6386263201b9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:42.736057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9c551510-5520-4a3e-a11a-6386263201b9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:42.820854 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9c551510-5520-4a3e-a11a-6386263201b9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:42.838377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9c551510-5520-4a3e-a11a-6386263201b9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1242 microversion: 2.1 time: 0.107068 Aug 31 10:56:42.839528 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 149/330] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:42 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:42.913854 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:42.930251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-49e79802-97bb-41cf-a837-e72c623866d9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.306142 Aug 31 10:56:42.931362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 182/331] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:42 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:43.058795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:43.059493 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:43.066610 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.067413 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.068083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.068652 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.069166 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.069642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.268312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:43.278760 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6635d178-8d95-4174-a685-3fd678faa235 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.224596 Aug 31 10:56:43.295739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 150/332] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:43 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:43.402056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:43.402660 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:43.409993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.411605 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.412129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.412944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.413508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.414048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.585076 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:43.593901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-bbc19bbb-6d5f-4fcc-b2af-10091a248512 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.195954 Aug 31 10:56:43.597818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 183/333] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:43 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:43.640812 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:43.641415 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:43.648142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.648668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.649099 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.649868 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.650323 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.650751 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.790620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:43.799372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8bfa03da-daa7-425d-93d0-7c96d84d6d08 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.162441 Aug 31 10:56:43.800133 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 151/334] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:43 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:43.862518 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:43.863368 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:43.870953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.871492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.873234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.876144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.876621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.877058 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.953150 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:43.953884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:43.960649 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.961291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.961749 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.962684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:43.963235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:43.963797 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:43.966892 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:43.977032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:43.982119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9d8d29d8-a6e6-4b72-ae54-b52e0db96e09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1246 microversion: 2.1 time: 0.124032 Aug 31 10:56:43.985894 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 184/335] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:43 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:44.126608 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:44.135968 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fbff8d35-0bf1-4502-930e-e7d7f1e94fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.186935 Aug 31 10:56:44.137804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 152/336] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:43 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:44.302609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:44.303128 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:44.313043 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:44.313580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:44.313994 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:44.314701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:44.315151 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:44.315678 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:44.475981 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:44.484464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-188b8558-24ac-4af7-9d34-638a1a85c569 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.186400 Aug 31 10:56:44.485647 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 185/337] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:44 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:44.617278 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:44.618219 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:44.624583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:44.625061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:44.625487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:44.626203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:44.626649 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:44.627061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:44.768118 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:44.776367 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-98cccd22-8ab7-48d4-93e4-54b8d1c2582b tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.163081 Aug 31 10:56:44.777152 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 153/338] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:44 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:44.822060 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:44.822672 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:44.831837 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:44.832357 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:44.832785 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:44.833494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:44.833974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:44.834390 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:44.991675 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:44.999998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5c619355-6f3b-43ab-a7a5-6c6b6729ca2e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.181867 Aug 31 10:56:45.000708 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 186/339] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:44 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:45.006019 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:45.006717 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:45.013107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:45.013689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:45.014197 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:45.014966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:45.015419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:45.015828 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:45.085501 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:45.098495 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1dcfe253-9095-4064-b8dd-f36edd4d44e2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1246 microversion: 2.1 time: 0.096572 Aug 31 10:56:45.099997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 154/340] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:45 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:45.158550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:45.159169 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:45.165556 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:45.166120 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:45.166553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:45.167260 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:45.167714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:45.168136 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:45.320724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:45.329405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c63cd407-22d8-4b71-a7eb-a30eefe18e39 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.175324 Aug 31 10:56:45.334159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 187/341] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:45 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:45.506879 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:45.507553 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:45.514785 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:45.515285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:45.515709 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:45.516432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:45.516875 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:45.517290 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:45.653656 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:45.661811 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-79936a06-b3ab-46a4-ba33-d8caf1355ef4 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.158871 Aug 31 10:56:45.662322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 155/342] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:45 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:45.798427 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:45.800217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:45.808182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:45.808689 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:45.809126 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:45.809890 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:45.810347 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:45.810770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:45.963781 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:45.972525 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-227f2dc1-b52d-4ed6-b075-ce9c980717cb tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.178039 Aug 31 10:56:45.973147 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 188/343] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:45 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:46.021254 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:46.022339 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:46.028966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:46.029448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:46.029908 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:46.030607 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:46.031057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:46.031470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:46.124442 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:46.125343 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:46.132144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:46.133210 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:46.134000 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:46.134946 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:46.135611 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:46.136184 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:46.248419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:46.250489 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:46.258701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e15b0b6a-d552-4530-9526-9cd89d2ddeaa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1246 microversion: 2.1 time: 0.142643 Aug 31 10:56:46.259310 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e2ebd70d-63d1-4631-b351-47cf016636bf tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.241946 Aug 31 10:56:46.259550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 189/344] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:46 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1246 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:46.260159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 156/345] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:46 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:46.351464 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:46.352522 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:46.359214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:46.359841 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:46.360353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:46.361138 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:46.361653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:46.362181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:46.506229 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:46.518665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d72bbddd-ed17-4be7-acea-7606dc4bc73d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.171577 Aug 31 10:56:46.521700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 157/346] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:46 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:46.688654 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:46.689264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:46.691285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:46.698452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:46.698940 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:46.699368 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:46.700087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:46.700596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:46.700956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:46.849713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=16 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:46.859800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:46.868952 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1444604d-b5ea-4cf9-a0d9-3210177e5e1d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.190023 Aug 31 10:56:46.869840 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 190/347] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:46 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:46.997344 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:46.997703 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:47.014154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.014645 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.015205 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:47.015962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.016406 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.016817 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:47.210818 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:47.229288 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-45af0749-d4ce-4af7-ab49-aa88a4fdd5d9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.236437 Aug 31 10:56:47.230168 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 158/348] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:46 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:47.282246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:47.282999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:47.285974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:47.286833 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:47.294282 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.295051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.295359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.295822 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:47.295953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.296359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:47.296994 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.297148 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.297611 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.297942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.298058 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:47.298605 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:47.388791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:47.407866 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-34f89683-6516-4d13-8f58-4a5b855ce7aa tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1246 microversion: 2.1 time: 0.129750 Aug 31 10:56:47.409230 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 191/349] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:47 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1246 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:47.504033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:47.512938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0e05df09-a886-4f07-a6b3-7f37e315e5c4 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.234362 Aug 31 10:56:47.513998 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 159/350] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:47 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:47.540254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:47.541159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:47.547785 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.548419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.548953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:47.549948 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.550605 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.551264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:47.710159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:47.720243 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-220965ed-2516-45ad-82b1-bebc08697c87 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.183960 Aug 31 10:56:47.720835 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 192/351] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:47 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:47.889867 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:47.890658 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:47.897321 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.898021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.898547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:47.899788 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:47.900235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:47.900647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:48.043757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:48.054840 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ef3ab2ad-9e5e-4eea-93d9-860ca5dd8966 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.168816 Aug 31 10:56:48.057821 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 160/352] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:47 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:48.252148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:48.253487 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:48.260025 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:48.260540 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:48.260965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:48.261684 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:48.262162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:48.262546 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:48.429089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:48.429707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:48.438014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:48.443484 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:48.450737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:48.451279 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:48.452364 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:48.452925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:48.453421 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:48.460429 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a74d4260-2886-49ce-b614-6cbe8867c0c0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.212673 Aug 31 10:56:48.461014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 193/353] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:48 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:48.526600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:48.534375 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:48.534993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:48.545850 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-96ec1ec9-5b3d-4e9a-9648-286e070ca267 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1246 microversion: 2.1 time: 0.120298 Aug 31 10:56:48.550190 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:48.550713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:48.551130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:48.551931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:48.552285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:48.552706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:48.566170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 161/354] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:48 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1246 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:48.722029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:48.730887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-28ac545e-7617-435f-8c16-d67bd898008b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.200532 Aug 31 10:56:48.731836 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 194/355] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:48 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:48.748241 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:48.748857 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:48.755634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:48.756122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:48.756551 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:48.757248 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:48.757897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:48.758254 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:48.945694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:48.961327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-202880f9-056a-4c18-aa4f-afb8c61cbd1b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.218029 Aug 31 10:56:48.962083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 162/356] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:48 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:49.089144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:49.091062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:49.098157 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.098715 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.099381 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:49.100627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.101265 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.101762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:49.320392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:49.329473 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-77dc7881-711c-4a2b-a6ee-89f902556c0d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.251727 Aug 31 10:56:49.330208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 195/357] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:49 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:49.481925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:49.482560 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:49.489302 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.489802 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.490240 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:49.490939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.491412 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.491852 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:49.583195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:49.584248 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:49.591163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.591743 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.592259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:49.593029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.593553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.594066 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:49.648391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:49.657558 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a322156b-e7fb-4788-a68b-5a09814e9a12 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.179905 Aug 31 10:56:49.658687 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 163/358] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:49 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:49.677887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:49.690393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b084184e-0ec2-48d6-99ff-dc9fb4c7556c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1246 microversion: 2.1 time: 0.110751 Aug 31 10:56:49.691730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 196/359] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:49 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:49.758694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:49.760014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:49.768470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.769311 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.770050 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:49.770999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.771865 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.772932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:49.972477 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:49.981092 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2096ca22-e74b-4452-bf4a-82f455aae3b5 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.230543 Aug 31 10:56:49.981704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 164/360] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:49 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:49.984216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:49.984934 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:49.991508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.992158 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.992689 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:49.993727 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:49.994480 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:49.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:50.140466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:50.150338 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f53f314a-dc00-4937-95b3-67d5b465d530 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.170327 Aug 31 10:56:50.150924 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 197/361] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:49 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:50.361401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:50.362057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:50.368645 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:50.369137 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:50.369577 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:50.370309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:50.370760 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:50.371176 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:50.373734 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:50.509657 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:50.518648 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-053cb196-a930-46fe-ba18-e03fbaffd0fc tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.161076 Aug 31 10:56:50.519215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 165/362] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:50 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:50.679879 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:50.680494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:50.687885 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:50.688355 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:50.688814 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:50.689517 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:50.690012 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:50.690424 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:50.711497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:50.712155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:50.718559 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:50.719042 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:50.719470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:50.720691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:50.721148 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:50.721552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:50.799222 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:50.808992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b09dec5f-764a-4d11-8461-d731a58c844c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1246 microversion: 2.1 time: 0.101316 Aug 31 10:56:50.809579 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 166/363] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:50 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:50.869795 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:50.881245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e79f8be8-1db6-495b-b697-32b249f1d251 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.205287 Aug 31 10:56:50.881863 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 198/364] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:50 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:51.002199 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:51.002842 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:51.009047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.009535 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.010013 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:51.010697 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.011175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.011587 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:51.150912 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:51.159011 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7da30d09-79d1-4555-8d11-7a0248af08d3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.160604 Aug 31 10:56:51.159689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 167/365] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:50 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:51.178214 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:51.178853 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:51.185495 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.186005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.186431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:51.187121 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.187565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.187977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:51.541378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:51.542315 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:51.554591 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.558352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.564676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:51.567025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.567669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.568467 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:51.590965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:51.606925 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-dce3076f-7e6c-4ec0-bf27-49d2ef735aed tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1725 microversion: 2.1 time: 0.432300 Aug 31 10:56:51.613815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 199/366] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:51 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1725 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:51.833445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:51.835025 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:51.841321 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.841847 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.842346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:51.845897 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.846412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.846846 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:51.955266 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:51.963549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-190edc3b-9d70-43ae-8fd7-a68661dc0a0a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.426973 Aug 31 10:56:51.964263 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 168/367] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:51 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:51.970269 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:51.972931 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:51.979702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.980421 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.981443 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:51.982196 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:51.982647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:51.988784 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:52.003804 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:52.020423 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-997f5e3e-2196-4407-a9bc-a779051620f6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1294 microversion: 2.1 time: 0.193344 Aug 31 10:56:52.021758 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 200/368] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:51 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1294 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:56:52.181117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:52.181761 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:52.188363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:52.188859 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:52.189316 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:52.190041 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:52.190476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:52.190883 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:52.211714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=100 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:52.334444 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:52.345578 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e150fd2f-d0cb-4cf5-9fce-daf1c833a461 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.379531 Aug 31 10:56:52.347143 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 169/369] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:51 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:52.553221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:52.571222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-723b7567-75d4-4588-9367-348312db127a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.394211 Aug 31 10:56:52.571993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 201/370] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:52 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:52.628260 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:52.628961 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:52.632004 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=4 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:52.636218 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:52.636956 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:52.637628 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:52.638430 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:52.639015 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:52.639631 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:52.775725 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-96eb65fa-bdd3-497a-91ae-0b9671e32253 req-c7f7a941-4dbb-4199-a1c1-a1d411b6b6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efcd181a-88d5-40b8-9b8a-1e8fcba6c798", "tag": "20b08b5e-962b-40a3-b343-72094d3551a4"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:52.785606 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-96eb65fa-bdd3-497a-91ae-0b9671e32253 req-c7f7a941-4dbb-4199-a1c1-a1d411b6b6c8 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:52.786060 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-96eb65fa-bdd3-497a-91ae-0b9671e32253 req-c7f7a941-4dbb-4199-a1c1-a1d411b6b6c8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:52.786683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-96eb65fa-bdd3-497a-91ae-0b9671e32253 req-c7f7a941-4dbb-4199-a1c1-a1d411b6b6c8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:52.798843 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-96eb65fa-bdd3-497a-91ae-0b9671e32253 req-c7f7a941-4dbb-4199-a1c1-a1d411b6b6c8 service nova] Creating event network-changed:20b08b5e-962b-40a3-b343-72094d3551a4 for instance efcd181a-88d5-40b8-9b8a-1e8fcba6c798 on hv-cinder-79578 Aug 31 10:56:52.804205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-96eb65fa-bdd3-497a-91ae-0b9671e32253 req-c7f7a941-4dbb-4199-a1c1-a1d411b6b6c8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032125 Aug 31 10:56:52.804861 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 202/371] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:52.840993 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=16 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:52.864107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:52.873088 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e7efc446-deb7-4930-9ef8-9ac7c3a01d41 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1702 microversion: 2.1 time: 0.248533 Aug 31 10:56:52.874116 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 170/372] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:52 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1702 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:52.895384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-562d8853-ceb5-4703-be69-723d40ca6afe tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:52.902215 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-562d8853-ceb5-4703-be69-723d40ca6afe tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:52.902701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-562d8853-ceb5-4703-be69-723d40ca6afe tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:52.903328 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-562d8853-ceb5-4703-be69-723d40ca6afe tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:52.928808 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-562d8853-ceb5-4703-be69-723d40ca6afe tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Going to try to start instance {{(pid=120482) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 10:56:52.975389 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-562d8853-ceb5-4703-be69-723d40ca6afe tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/action" status: 202 len: 0 microversion: 2.1 time: 0.084272 Aug 31 10:56:52.975915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 203/373] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:56:52 2022] POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:56:52.985244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:52.988179 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:52.988416 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:52.988512 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:52.996457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:52.996985 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:52.997421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:52.998161 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:52.998645 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:52.999085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:53.010489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:53.011000 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:53.011442 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:53.012144 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:53.012609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:53.015952 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:53.563922 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:53.574921 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d5665b43-b3a0-4a49-bc5f-8899e9906302 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1711 microversion: 2.1 time: 0.593494 Aug 31 10:56:53.575965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 204/374] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:52 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1711 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:53.580877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:53.581594 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:53.590294 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:53.591005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:53.591569 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:53.592772 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:53.592918 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:53.594001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:53.606798 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:53.615509 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-20dc3a6c-3185-4179-bad8-34ab76c659c0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.634483 Aug 31 10:56:53.626588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 171/375] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:52 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:53.637138 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:53.637988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:53.650023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:53.650655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:53.651332 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:53.652259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:53.653203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:53.653676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:53.698374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:53.706552 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d3773b44-4534-42a2-a586-07350b115113 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1294 microversion: 2.1 time: 0.129536 Aug 31 10:56:53.707150 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 205/376] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:53 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1294 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:53.711643 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:53.712487 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:53.714644 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:53.724983 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:53.725646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:53.726950 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:53.727853 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:53.728553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:53.729122 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:54.031284 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:54.039506 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-329d7f22-ddf8-45eb-a858-f2794e1fdf3a tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.411608 Aug 31 10:56:54.041679 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 172/377] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:53 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:54.075369 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:54.083670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1795ddcf-095b-4649-aadd-c1c0dc3923a9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1508 microversion: 2.1 time: 0.375541 Aug 31 10:56:54.084311 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 206/378] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:53 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1508 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:54.596655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:54.597169 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:54.603243 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:54.603729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:54.604189 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:54.604888 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:54.605352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:54.605762 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:54.642160 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:54.642780 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:54.649151 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:54.650062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:54.650456 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:54.651381 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:54.651796 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:54.652216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:55.164974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:55.184230 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6850e414-702d-4b71-b01c-086330740ad3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1711 microversion: 2.1 time: 0.591406 Aug 31 10:56:55.185511 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 173/379] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:54 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1711 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:55.190983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:55.198151 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:55.214721 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:55.218482 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:55.219720 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:55.221267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:55.224739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:55.227432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:55.246059 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:55.254184 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ee4a071b-1a9d-4497-a590-4061478877e0 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.615775 Aug 31 10:56:55.254756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 207/380] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:54 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:55.281433 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-5a897f1f-e26c-484a-afe6-178a10f922ea req-f7da6a0d-b04b-48c4-b39b-661640be3c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c57211-e6e0-4f67-9029-1806387921e7", "tag": "ad172ad1-ff5a-4d9c-8473-07c7509a5e88"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:55.304725 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-5a897f1f-e26c-484a-afe6-178a10f922ea req-f7da6a0d-b04b-48c4-b39b-661640be3c0c service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:55.305227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-5a897f1f-e26c-484a-afe6-178a10f922ea req-f7da6a0d-b04b-48c4-b39b-661640be3c0c service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:55.305676 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-5a897f1f-e26c-484a-afe6-178a10f922ea req-f7da6a0d-b04b-48c4-b39b-661640be3c0c service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:55.334429 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-5a897f1f-e26c-484a-afe6-178a10f922ea req-f7da6a0d-b04b-48c4-b39b-661640be3c0c service nova] Creating event network-changed:ad172ad1-ff5a-4d9c-8473-07c7509a5e88 for instance c6c57211-e6e0-4f67-9029-1806387921e7 on hv-cinder-79578 Aug 31 10:56:55.341185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-5a897f1f-e26c-484a-afe6-178a10f922ea req-f7da6a0d-b04b-48c4-b39b-661640be3c0c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063498 Aug 31 10:56:55.342426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 208/381] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:55.348928 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:55.350276 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:55.357441 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:55.360654 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:55.361329 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:55.362244 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:55.363006 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:55.363688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:55.397044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:55.418942 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-960a049d-4a1d-4b5a-bbd2-ea3c2d471ceb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1300 microversion: 2.1 time: 0.231966 Aug 31 10:56:55.423703 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 174/382] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:55 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1300 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:55.439504 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:55.446006 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:55.464651 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:55.466283 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:55.468399 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:55.473832 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:55.474778 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:55.476175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:56.090199 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:56.106101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-62cd8b52-74b1-47c9-a7ce-6e8b6754dbb9 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.762121 Aug 31 10:56:56.106820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 209/383] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:55 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:56.115874 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:56.124200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-58931d9e-a08a-41e1-afef-316f9f911996 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1514 microversion: 2.1 time: 0.699103 Aug 31 10:56:56.124918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 175/384] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:55 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1514 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:56.209901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:56.209901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:56.228046 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:56.229585 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:56.230159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:56.230897 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:56.231346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:56.232173 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:56.284694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:56.286127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:56.295761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:56.296849 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:56.297326 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:56.298280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:56.299817 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:56.300633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:56.514238 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:56.523220 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-321c440d-390a-4dbc-95a3-809d35e122ae tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1711 microversion: 2.1 time: 0.322149 Aug 31 10:56:56.524810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 210/385] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:56 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1711 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:56.530290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:56.530893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:56.536939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:56.543724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:56.544688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:56.545704 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:56.546926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:56.547546 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:56.548040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:56.550159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8ccb8268-aecb-45be-8773-0d56d426fa5a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.272610 Aug 31 10:56:56.551498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 176/386] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:56 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:56.655802 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-efb4d39c-6716-4dbd-85e6-4d3c655c2b7d req-0536f82e-b0a5-445e-ace1-55129382eea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e849d954-3d1f-494d-8394-f6ec1dba55c4", "tag": "62d1ed4c-0d7e-428e-b0b3-580b313c4366"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:56.683308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-efb4d39c-6716-4dbd-85e6-4d3c655c2b7d req-0536f82e-b0a5-445e-ace1-55129382eea8 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:56.683784 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-efb4d39c-6716-4dbd-85e6-4d3c655c2b7d req-0536f82e-b0a5-445e-ace1-55129382eea8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:56.684216 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-efb4d39c-6716-4dbd-85e6-4d3c655c2b7d req-0536f82e-b0a5-445e-ace1-55129382eea8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:56.704057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-efb4d39c-6716-4dbd-85e6-4d3c655c2b7d req-0536f82e-b0a5-445e-ace1-55129382eea8 service nova] Creating event network-changed:62d1ed4c-0d7e-428e-b0b3-580b313c4366 for instance e849d954-3d1f-494d-8394-f6ec1dba55c4 on hv-cinder-79578 Aug 31 10:56:56.708092 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:56.710403 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-efb4d39c-6716-4dbd-85e6-4d3c655c2b7d req-0536f82e-b0a5-445e-ace1-55129382eea8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058390 Aug 31 10:56:56.711197 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 177/387] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:56:56.716523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c4ffda12-1057-4b97-a803-e830945872ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.190659 Aug 31 10:56:56.717113 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 211/388] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:56 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:57.127419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-680534395", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "networks": [{"uuid": "fe0f8a55-6b5e-4ea7-b30a-51663df0572c"}]}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:57.127866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:57.128920 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:57.135955 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.136661 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.137266 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:57.138151 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.138760 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.139457 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:57.211710 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] validate_networks() for [('fe0f8a55-6b5e-4ea7-b30a-51663df0572c', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:56:57.481430 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:57.498509 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-78bbc0ac-38ea-4508-92ac-c299d4772ba4 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.375320 Aug 31 10:56:57.499358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 178/389] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:57 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:57.544697 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:57.545313 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:57.551754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.552222 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.552656 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:57.553346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.553810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.554245 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:57.771222 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:57.780181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4ad498e1-26d9-4855-95f9-07ff1233835e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1711 microversion: 2.1 time: 0.239462 Aug 31 10:56:57.780761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 179/390] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:57 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1711 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:57.798281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5c43439e-2fce-41f2-8a2d-c306f721c9fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'create', calling method: .version_select at 0x7f37a8e8ba60>, body: {"keypair": {"name": "tempest-keypair-1930968349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORhbjtMFNAZpjnt6KtB5OH2ZdiFqORVAbtTGWh+sl+4p1T5r5uwXurj1d2ksggTVNMobYdpGzMPMsjQb3GqJdMSqV4kopYTRPTC+H3bzUULomIIayZn3SgOc9YewlAMaQ=="}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:56:57.806272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:56:57.807103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:56:57.808212 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:56:57.808808 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:56:57.809385 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:56:57.823033 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.823530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.824023 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:57.824780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-5c43439e-2fce-41f2-8a2d-c306f721c9fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Getting quotas for project 3aabb02cf14541f997b08fe0853acac0. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:56:57.824929 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.825536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.835128 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-5c43439e-2fce-41f2-8a2d-c306f721c9fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Getting quotas for user 3dc4ac4ada004bbb942c36755f4a7cd1 and project 3aabb02cf14541f997b08fe0853acac0. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:56:57.838254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:57.866209 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Getting quotas for project 4ff7c6e80bed43ecbcf17e4fa1bad450. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:56:57.870641 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Getting quotas for user 9cf2f9dbdcfe4cce91fd4c03cd8e8bba and project 4ff7c6e80bed43ecbcf17e4fa1bad450. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:56:57.883397 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5c43439e-2fce-41f2-8a2d-c306f721c9fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088776 Aug 31 10:56:57.883855 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:56:57.884483 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 180/391] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 10:56:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:56:57.886405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:56:57.889561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:57.890252 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:57.897690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.898626 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.899125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:57.899970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.901224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.901714 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:57.950233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8d8d5772-8b43-45e7-a7d8-7dc19c734ea1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826909 Aug 31 10:56:57.956802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 212/392] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:56:57.962527 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:57.963319 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:57.969896 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.970568 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.973051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:57.973954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:57.974550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:57.978422 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:58.103909 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:58.115960 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5a5bdf4f-8bb6-4191-91de-a8f83250d6c8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.230400 Aug 31 10:56:58.126374 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 181/393] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:57 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:58.134595 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1fcdd11c-3021-40a9-b196-ffa72302cdf7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:58.135632 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1fcdd11c-3021-40a9-b196-ffa72302cdf7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:58.241818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:58.243889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1fcdd11c-3021-40a9-b196-ffa72302cdf7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:58.253271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c1c7fab5-1c13-41a2-9fd9-f69f1f295977 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.294837 Aug 31 10:56:58.254456 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 213/394] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:57 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:58.260016 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1fcdd11c-3021-40a9-b196-ffa72302cdf7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1218 microversion: 2.1 time: 0.132329 Aug 31 10:56:58.261386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 182/395] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:58 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:58.521958 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:58.522790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:58.529604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:58.530445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:58.530940 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:58.531632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:58.532087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:58.532724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:58.694034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:58.704634 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6b7d32ce-acb3-4cf6-bccb-cc8fd840090e tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.187719 Aug 31 10:56:58.718518 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 214/396] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:58 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:58.802089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:58.803357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:58.811066 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:58.811826 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:58.812214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:58.812918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:58.813465 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:58.813806 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:59.072762 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:59.091241 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-be9464ec-bc5b-40fa-9e29-0ee68b5ac620 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1715 microversion: 2.1 time: 0.294046 Aug 31 10:56:59.107416 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 183/397] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:58 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1715 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:59.151498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:59.152068 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:59.171575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:59.172077 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:59.174935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:59.176107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:59.177010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:59.177595 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:59.274697 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:59.275918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:59.277348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:59.294005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:59.294507 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:59.294942 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:59.295650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:59.296099 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:59.296521 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:59.326411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:59.507312 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:59.516498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-afa1761e-5378-4cfd-bee2-74f4e92129ee tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.369382 Aug 31 10:56:59.517191 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 215/398] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:59 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:59.529668 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:59.531259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:59.539013 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:59.539558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:59.539994 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:59.540755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:59.541212 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:59.541631 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:59.572619 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:59.580691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0a5ec2d6-d0fe-4724-89d4-1af499c5e2f2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.309878 Aug 31 10:56:59.581286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 184/399] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:59 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:59.609598 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:59.617490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-09e5b8f0-9d09-468d-9eeb-f3b67f6e2c19 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1270 microversion: 2.1 time: 0.098329 Aug 31 10:56:59.618170 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 216/400] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:59 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:59.727111 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:56:59.728963 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:56:59.736346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:59.736908 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:59.737443 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:59.738235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:56:59.738868 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:56:59.739294 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:56:59.886951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:56:59.894951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9626e2d7-cde3-4342-9f18-54a318958d01 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.172271 Aug 31 10:56:59.895552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 185/401] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:56:59 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:56:59.904217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1994027442", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae23e21a-87d5-483e-aa49-0c7be5f1867f"}], "security_groups": [{"name": "tempest-securitygroup--257298671"}], "key_name": "tempest-keypair-1930968349", "user_data": "}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:00.014726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] validate_networks() for [('ae23e21a-87d5-483e-aa49-0c7be5f1867f', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:57:00.414498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:57:00.415103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:57:00.415618 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:57:00.416032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:57:00.416443 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:57:00.426364 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:00.427146 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:00.427841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:00.428624 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:00.429154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:00.429579 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:00.447481 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Getting quotas for project 3aabb02cf14541f997b08fe0853acac0. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:57:00.451391 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Getting quotas for user 3dc4ac4ada004bbb942c36755f4a7cd1 and project 3aabb02cf14541f997b08fe0853acac0. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:57:00.462542 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:57:00.464763 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:57:00.527133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-94249180-a5e4-4bc2-b29b-99aab753b048 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.627554 Aug 31 10:57:00.527913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 217/402] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:56:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:57:00.539994 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:00.540833 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:00.543076 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4ff6d3f5-186f-4866-81d6-25c1b9a6b64c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:00.543697 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4ff6d3f5-186f-4866-81d6-25c1b9a6b64c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:00.559962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:00.560523 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:00.561086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:00.561999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:00.562461 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:00.562889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:00.627505 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4ff6d3f5-186f-4866-81d6-25c1b9a6b64c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:00.638594 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4ff6d3f5-186f-4866-81d6-25c1b9a6b64c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1246 microversion: 2.1 time: 0.102318 Aug 31 10:57:00.639386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 218/403] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:00 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:00.658092 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:00.658644 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:00.666026 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:00.666512 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:00.667140 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:00.667847 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:00.668299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:00.668882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:01.022824 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:01.036534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6510495f-c15e-405e-8481-9498a6fc5277 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.499918 Aug 31 10:57:01.037919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 186/404] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:00 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:01.054897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:01.055576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:01.061977 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:01.062176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:01.062442 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:01.062869 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:01.063562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:01.064000 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:01.064570 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:01.091010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0fb4b769-a6ad-44b0-8b0d-14808b517d3b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.435356 Aug 31 10:57:01.096258 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 219/405] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:00 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:01.115554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-29e204b1-0631-4a8a-a373-fb8d895e4f7a req-5f39b1cf-064c-446a-bec9-7cd9f901ec68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcd181a-88d5-40b8-9b8a-1e8fcba6c798", "name": "network-vif-plugged", "status": "completed", "tag": "20b08b5e-962b-40a3-b343-72094d3551a4"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:01.133323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-29e204b1-0631-4a8a-a373-fb8d895e4f7a req-5f39b1cf-064c-446a-bec9-7cd9f901ec68 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:01.133869 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-29e204b1-0631-4a8a-a373-fb8d895e4f7a req-5f39b1cf-064c-446a-bec9-7cd9f901ec68 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:01.134369 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-29e204b1-0631-4a8a-a373-fb8d895e4f7a req-5f39b1cf-064c-446a-bec9-7cd9f901ec68 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:01.146723 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-29e204b1-0631-4a8a-a373-fb8d895e4f7a req-5f39b1cf-064c-446a-bec9-7cd9f901ec68 service nova] Creating event network-vif-plugged:20b08b5e-962b-40a3-b343-72094d3551a4 for instance efcd181a-88d5-40b8-9b8a-1e8fcba6c798 on hv-cinder-79578 Aug 31 10:57:01.152863 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-29e204b1-0631-4a8a-a373-fb8d895e4f7a req-5f39b1cf-064c-446a-bec9-7cd9f901ec68 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055055 Aug 31 10:57:01.153748 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 220/406] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:01.163396 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:01.164421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:01.173622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:01.174959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:01.175780 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:01.176650 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:01.177265 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:01.177865 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:01.181655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:01.194669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b3a82a8d-a31b-4962-adb1-11826ea37360 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1276 microversion: 2.1 time: 0.155360 Aug 31 10:57:01.196440 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 187/407] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:01 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:01.216189 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:01.494968 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:01.507658 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-075e5090-acc3-4172-9c89-dff673cd8f06 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.348574 Aug 31 10:57:01.508612 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 221/408] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:01 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:01.661699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:01.662339 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:01.669039 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:01.669539 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:01.670010 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:01.670728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:01.671181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:01.671599 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:01.974071 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:01.982140 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6376105e-3283-453f-ada8-08b7da49aaea tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1298 microversion: 2.1 time: 0.324475 Aug 31 10:57:01.988918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 188/409] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:01 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1298 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:02.058722 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:02.059371 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:02.066361 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:02.066856 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:02.067295 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:02.068014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:02.068471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:02.068897 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:02.120719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:02.122102 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:02.128763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:02.129252 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:02.129689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:02.130449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:02.130897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:02.131318 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:02.292609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:02.301016 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6b20e8af-b3d8-4205-8643-3f47a3b3f36b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.246835 Aug 31 10:57:02.301623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 222/410] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:02 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:02.308745 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:02.308745 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:02.312882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:02.313353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:02.313989 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:02.314857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:02.315315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:02.315755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:02.323466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:02.331817 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7207bd92-29fb-480d-a109-bee10f9a809c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.215135 Aug 31 10:57:02.332401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 189/411] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:02 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:02.529076 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:02.530118 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:02.537475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:02.538719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:02.539549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:02.541186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:02.541728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:02.542317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:02.542775 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:02.556341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7e6b88c2-a340-47f3-a20b-17f385c0efed tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.253441 Aug 31 10:57:02.557600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 223/412] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:02 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:02.765927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:02.779759 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d2dbde6d-3677-4402-b8df-bffe49c25da1 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1315 microversion: 2.1 time: 0.254272 Aug 31 10:57:02.796633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 190/413] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:02 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:03.003317 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:03.003928 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:03.010255 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.010742 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.011176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.011856 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.012313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.012786 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.083526 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:03.091591 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9fa73bff-5ab3-4cb9-8824-54cf9d7fd355 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1306 microversion: 2.1 time: 0.092263 Aug 31 10:57:03.092161 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 224/414] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:02 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:03.121730 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-ed73f899-377b-46ea-bb0e-563b9866589b req-a73b8361-d996-4809-a553-33069f54aef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2336d69f-d13a-4040-bd92-5549daa38d82", "tag": "626f67f7-9109-4add-8ced-00a8ba6b25da"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:03.132679 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-ed73f899-377b-46ea-bb0e-563b9866589b req-a73b8361-d996-4809-a553-33069f54aef9 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.133210 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-ed73f899-377b-46ea-bb0e-563b9866589b req-a73b8361-d996-4809-a553-33069f54aef9 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.134044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-ed73f899-377b-46ea-bb0e-563b9866589b req-a73b8361-d996-4809-a553-33069f54aef9 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.147340 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-ed73f899-377b-46ea-bb0e-563b9866589b req-a73b8361-d996-4809-a553-33069f54aef9 service nova] Creating event network-changed:626f67f7-9109-4add-8ced-00a8ba6b25da for instance 2336d69f-d13a-4040-bd92-5549daa38d82 on hv-cinder-79578 Aug 31 10:57:03.154996 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-ed73f899-377b-46ea-bb0e-563b9866589b req-a73b8361-d996-4809-a553-33069f54aef9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036847 Aug 31 10:57:03.155698 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 191/415] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:03.170340 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-825ec94a-1ecb-43c2-92c5-ac352feba6f0 req-34fc5d70-bc92-42c1-b56d-80c026a7811d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c57211-e6e0-4f67-9029-1806387921e7", "name": "network-vif-plugged", "status": "completed", "tag": "ad172ad1-ff5a-4d9c-8473-07c7509a5e88"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:03.182207 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-825ec94a-1ecb-43c2-92c5-ac352feba6f0 req-34fc5d70-bc92-42c1-b56d-80c026a7811d service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.183164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-825ec94a-1ecb-43c2-92c5-ac352feba6f0 req-34fc5d70-bc92-42c1-b56d-80c026a7811d service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.183709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-825ec94a-1ecb-43c2-92c5-ac352feba6f0 req-34fc5d70-bc92-42c1-b56d-80c026a7811d service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.196757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-825ec94a-1ecb-43c2-92c5-ac352feba6f0 req-34fc5d70-bc92-42c1-b56d-80c026a7811d service nova] Creating event network-vif-plugged:ad172ad1-ff5a-4d9c-8473-07c7509a5e88 for instance c6c57211-e6e0-4f67-9029-1806387921e7 on hv-cinder-79578 Aug 31 10:57:03.201827 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-825ec94a-1ecb-43c2-92c5-ac352feba6f0 req-34fc5d70-bc92-42c1-b56d-80c026a7811d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036109 Aug 31 10:57:03.202431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 225/416] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:03.323357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:03.324118 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:03.331036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.331468 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.331880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.332621 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.333047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.333466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.358658 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:03.359687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:03.371910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.377172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.377975 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.378891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.382657 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.383421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.730330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:03.738176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:03.746346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3a8ea6ab-86de-4f54-815b-e0fab38f862e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.427560 Aug 31 10:57:03.747063 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1f8651ca-d84a-4fac-a862-20855545cc4c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.397815 Aug 31 10:57:03.748226 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 226/417] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:03 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:57:03.762591 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 192/418] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:03 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:03.768846 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0e96d63a-fc15-4822-9b6c-b6ad18f4d242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:03.769326 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0e96d63a-fc15-4822-9b6c-b6ad18f4d242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:03.769802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:03.771342 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:03.778841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.779599 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.780134 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.781037 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.782218 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.782879 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.788506 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e96d63a-fc15-4822-9b6c-b6ad18f4d242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.789234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e96d63a-fc15-4822-9b6c-b6ad18f4d242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.789886 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e96d63a-fc15-4822-9b6c-b6ad18f4d242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.790808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e96d63a-fc15-4822-9b6c-b6ad18f4d242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.791758 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e96d63a-fc15-4822-9b6c-b6ad18f4d242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.792325 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e96d63a-fc15-4822-9b6c-b6ad18f4d242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.819942 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0e96d63a-fc15-4822-9b6c-b6ad18f4d242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/ips" status: 200 len: 150 microversion: 2.20 time: 0.056159 Aug 31 10:57:03.820833 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 193/419] 10.222.0.75 () {60 vars in 1289 bytes} [Wed Aug 31 10:57:03 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:57:03.825503 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:03.835368 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:03.849755 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.852330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.852816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:03.853724 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:03.854380 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:03.854810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.064340 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:04.075217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:04.080529 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-31531384-4ecb-48f0-bc61-2ca968f00458 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.329902 Aug 31 10:57:04.082992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 227/420] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:03 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:04.089854 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b95e84bf-b5fd-415b-aaca-8f03c8fbf311 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1465 microversion: 2.1 time: 0.265560 Aug 31 10:57:04.090540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 194/421] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:03 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1465 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:04.113575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:04.114282 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:04.122439 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.122938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.123702 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.124715 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.125179 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.125594 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.166460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:04.167044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:04.177075 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.182890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.183349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.184107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.184568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.184998 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.264792 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:57:04.404981 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8f948031-e2bf-419f-94be-9e21622f1229 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "DELETE /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 204 len: 0 microversion: 2.1 time: 0.243383 Aug 31 10:57:04.409594 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 195/422] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:57:04 2022] DELETE /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 10:57:04.417299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:04.428936 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-84233b20-7bd4-40a6-9d06-2cce3a4c9230 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.319745 Aug 31 10:57:04.429613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 228/423] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:04 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:04.435949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:04.436660 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:04.447763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.448250 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.448686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.449423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.449923 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.450382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.599138 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:04.607225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e81dcc3b-b5c9-40e3-8e71-e3dd0a5871d0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1471 microversion: 2.1 time: 0.193676 Aug 31 10:57:04.607799 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 196/424] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:04 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:04.784136 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:04.784850 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:04.787995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:04.788683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:04.792297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.792622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.793109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.794159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.794480 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.794964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.795559 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.796037 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.796471 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:04.797153 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:04.797627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:04.798345 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:05.000539 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:05.002628 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:05.012851 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-286f945a-cedb-4bcf-9572-d32e76950d4e tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.232763 Aug 31 10:57:05.013428 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 229/425] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:04 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:05.030710 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4eb78c8c-25d1-44ee-9f3f-664e8e1a1339 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.246584 Aug 31 10:57:05.031291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 197/426] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:04 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:05.102310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:05.102977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:05.109409 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:05.110031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:05.110549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:05.111308 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:05.111812 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:05.112230 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:05.216524 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-7474e28b-787a-4d6e-8726-34f03620aea6 req-ee1a87f7-1649-416c-8421-052d23f4c531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e849d954-3d1f-494d-8394-f6ec1dba55c4", "name": "network-vif-plugged", "status": "completed", "tag": "62d1ed4c-0d7e-428e-b0b3-580b313c4366"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:05.227292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-7474e28b-787a-4d6e-8726-34f03620aea6 req-ee1a87f7-1649-416c-8421-052d23f4c531 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:05.228052 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-7474e28b-787a-4d6e-8726-34f03620aea6 req-ee1a87f7-1649-416c-8421-052d23f4c531 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:05.228665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-7474e28b-787a-4d6e-8726-34f03620aea6 req-ee1a87f7-1649-416c-8421-052d23f4c531 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:05.240867 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-7474e28b-787a-4d6e-8726-34f03620aea6 req-ee1a87f7-1649-416c-8421-052d23f4c531 service nova] Creating event network-vif-plugged:62d1ed4c-0d7e-428e-b0b3-580b313c4366 for instance e849d954-3d1f-494d-8394-f6ec1dba55c4 on hv-cinder-79578 Aug 31 10:57:05.244697 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:05.249295 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-7474e28b-787a-4d6e-8726-34f03620aea6 req-ee1a87f7-1649-416c-8421-052d23f4c531 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035157 Aug 31 10:57:05.250465 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 198/427] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:57:05.256860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1d6c86dd-316b-431e-9511-97a12e854653 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.158451 Aug 31 10:57:05.272059 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 230/428] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:05 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:05.280137 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-f9724cff-7ce8-4eb3-9a4b-23ee27264556 req-65e2518c-3178-4988-a75e-c61399ad5020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80088fbb-9cea-4ee2-8224-ec783c4f9397", "tag": "64257485-56f5-4b89-a0a9-09ac5a18b844"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:05.290941 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-f9724cff-7ce8-4eb3-9a4b-23ee27264556 req-65e2518c-3178-4988-a75e-c61399ad5020 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:05.291503 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-f9724cff-7ce8-4eb3-9a4b-23ee27264556 req-65e2518c-3178-4988-a75e-c61399ad5020 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:05.291916 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-f9724cff-7ce8-4eb3-9a4b-23ee27264556 req-65e2518c-3178-4988-a75e-c61399ad5020 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:05.303090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-f9724cff-7ce8-4eb3-9a4b-23ee27264556 req-65e2518c-3178-4988-a75e-c61399ad5020 service nova] Creating event network-changed:64257485-56f5-4b89-a0a9-09ac5a18b844 for instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 on hv-cinder-79578 Aug 31 10:57:05.308761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-f9724cff-7ce8-4eb3-9a4b-23ee27264556 req-65e2518c-3178-4988-a75e-c61399ad5020 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033350 Aug 31 10:57:05.309357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 199/429] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:57:05.452680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:05.453297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:05.460416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:05.460909 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:05.461339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:05.462060 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:05.462517 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:05.462943 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:05.593050 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:05.601181 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-31b8ab32-1d2c-477b-bf26-2b17013ae2d0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.152529 Aug 31 10:57:05.601744 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 231/430] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:05 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:05.632700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:05.633648 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:05.640337 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:05.640828 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:05.641264 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:05.641999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:05.642460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:05.642884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:05.790953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:05.803258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-65e87adb-5241-469a-ac76-c8f9087801e0 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1471 microversion: 2.1 time: 0.176715 Aug 31 10:57:05.803992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 200/431] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:05 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:05.996177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:05.996740 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:06.003118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.003600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.004030 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.004716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.005142 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.005553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.029203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lazy-loading 'flavor' on Instance uuid a8fdb0f3-110c-4250-8dcc-e44426464c66 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:57:06.036100 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:06.036707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:06.043299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.043783 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.045430 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.045430 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.045430 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.045875 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.227915 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:06.241439 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:06.247572 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-80355200-5c44-4268-8dcc-70a8f96662a8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1358 microversion: 2.1 time: 0.216297 Aug 31 10:57:06.248089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 201/432] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:06 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:06.258361 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:06.266130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:06.272082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d16adbe9-0585-45f5-8d9f-062a4f969b24 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/action" status: 202 len: 0 microversion: 2.20 time: 0.281111 Aug 31 10:57:06.273237 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 232/433] 10.222.0.75 () {62 vars in 1319 bytes} [Wed Aug 31 10:57:05 2022] POST /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:06.280685 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:06.281540 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:06.284890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.286063 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.286824 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.287565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.288022 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.288818 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.296546 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.297504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.298213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.299237 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.299727 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.300591 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.490965 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:06.494222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:06.499655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7061d655-5685-4e04-8104-db9ae584fd33 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.245673 Aug 31 10:57:06.500256 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 202/434] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:06 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:06.502323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e459e68f-3fb7-4ef6-90c2-d9730e691388 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.226346 Aug 31 10:57:06.502885 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 233/435] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:06 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:57:06.505011 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:06.505647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:06.511976 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.512535 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.513039 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.513736 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.514226 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.514648 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.622388 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:06.623111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:06.629312 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.629851 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.630297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.630992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.631749 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.632176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.649432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:06.663728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:06.665381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:06.666595 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2aa047bc-9fea-44aa-aac6-aca4a5ce0902 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.165351 Aug 31 10:57:06.667149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 203/436] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:06 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:06.764035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:06.772002 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8b58d551-d5f5-496f-96e4-1ac1f1635bae tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.153608 Aug 31 10:57:06.772572 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 234/437] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:06 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:06.825106 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:06.831447 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:06.838690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.839178 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.839619 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:06.840325 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:06.840771 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:06.852003 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.098919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:07.108645 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ad59fcc7-f3fb-4cc0-9720-a8da3794b433 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1471 microversion: 2.1 time: 0.287085 Aug 31 10:57:07.122375 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 204/438] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:06 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:07.273011 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:07.273591 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:07.280431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.280911 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.281351 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.282093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.282544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.282963 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.520799 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:07.521862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:07.528309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.528775 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.529229 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.529963 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.530418 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.530844 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.647681 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:07.655864 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c0b689ce-6ded-492b-8125-3cfb6e34885d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1549 microversion: 2.1 time: 0.389618 Aug 31 10:57:07.656465 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 235/439] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:07 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1549 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:07.676641 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:07.677264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:07.683778 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.684284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.684695 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.685637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.685890 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.686342 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.897028 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:07.905532 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f01bbf39-02f9-4d3a-9c72-d0ff50e35abf tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.388689 Aug 31 10:57:07.906621 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 205/440] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:07 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:07.913804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:07.914561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:07.921102 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.921814 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.922432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.923177 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.923992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.924421 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.931254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:07.936007 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:07.941216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e5b26bff-d36c-4be4-a017-d3bf0bf2e403 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.270056 Aug 31 10:57:07.941926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 236/441] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:07 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:07.946672 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:07.947366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:07.956187 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.956799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.957313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:07.958138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:07.958661 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:07.959151 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.171114 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:08.180299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-377f998e-1546-46db-a491-e6e57c54dde2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1549 microversion: 2.1 time: 0.272361 Aug 31 10:57:08.180904 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 206/442] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:07 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1549 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:08.185687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:08.186642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:08.187302 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:08.193829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.194263 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:08.194385 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.194830 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.195549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.195711 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:08.196346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.196777 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.196916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-486d58b9-a206-4a17-8437-6f1da4c5a29d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.253967 Aug 31 10:57:08.197474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 237/443] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:07 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:08.201905 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-32478425-980c-4a99-b848-fb2c6ac29b0c req-05028995-0b2f-420c-af7c-bcca266a3f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efcd181a-88d5-40b8-9b8a-1e8fcba6c798", "name": "network-vif-deleted", "tag": "20b08b5e-962b-40a3-b343-72094d3551a4"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:08.211263 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-32478425-980c-4a99-b848-fb2c6ac29b0c req-05028995-0b2f-420c-af7c-bcca266a3f34 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.211743 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-32478425-980c-4a99-b848-fb2c6ac29b0c req-05028995-0b2f-420c-af7c-bcca266a3f34 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.212776 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-32478425-980c-4a99-b848-fb2c6ac29b0c req-05028995-0b2f-420c-af7c-bcca266a3f34 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.223440 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-32478425-980c-4a99-b848-fb2c6ac29b0c req-05028995-0b2f-420c-af7c-bcca266a3f34 service nova] Creating event network-vif-deleted:20b08b5e-962b-40a3-b343-72094d3551a4 for instance efcd181a-88d5-40b8-9b8a-1e8fcba6c798 on hv-cinder-79578 Aug 31 10:57:08.228338 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-32478425-980c-4a99-b848-fb2c6ac29b0c req-05028995-0b2f-420c-af7c-bcca266a3f34 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029640 Aug 31 10:57:08.228932 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 238/444] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:08.233986 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:08.234683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:08.240843 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.241334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.241800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.242495 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.242956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.243384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.251896 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=6 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:08.318881 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:08.327086 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-039b15e7-6f25-472f-b1bc-8a1ce890291f tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1300 microversion: 2.1 time: 0.096955 Aug 31 10:57:08.327658 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 239/445] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:08 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:08.332171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:08.336956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:08.338024 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Searching by: {'deleted': False, 'project_id': '6edee50c9ca84b43b58209073abb6642'} {{(pid=120482) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 10:57:08.339978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:08.346607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.347148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.347586 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.348262 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.348731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.349147 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.359596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:08.367769 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a10e8060-e748-4d8e-9925-5b924578ed98 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.185835 Aug 31 10:57:08.368342 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 207/446] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:08 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:08.441959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.multi_cell_list [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120482) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 10:57:08.535218 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ba44169a-b5ce-482f-9bd0-dc38e252db5f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206499 Aug 31 10:57:08.535816 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 240/447] 10.222.0.75 () {58 vars in 1125 bytes} [Wed Aug 31 10:57:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:08.547133 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:08.547745 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:08.554217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.554688 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.555108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.555793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.556267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.556685 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.692827 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:08.705490 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-652ad0fc-b17d-4211-a894-71c8c4d12281 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1549 microversion: 2.1 time: 0.161922 Aug 31 10:57:08.706386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 208/448] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:08 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:08.927406 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:08.927954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:08.934906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.935402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.935841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.936573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.937066 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.937514 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.962844 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:08.963756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:08.971397 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.971904 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.973044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:08.973807 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:08.974267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:08.974693 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:09.147853 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:09.156058 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9f25ef3c-c498-4255-b33d-9a10bbe1dd83 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1367 microversion: 2.1 time: 0.232687 Aug 31 10:57:09.156754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 241/449] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:08 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:09.159019 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:09.167409 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e5e46710-8554-4f8d-8d82-ee861739d23c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.208534 Aug 31 10:57:09.167984 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 209/450] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:08 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:57:09.224179 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:09.224874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:09.232225 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:09.232716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:09.233114 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:09.234069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:09.234293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:09.234686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:09.349272 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:09.349924 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:09.356696 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:09.357192 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:09.357629 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:09.358372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:09.358819 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:09.359603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:09.627563 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:09.635909 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0c2f4697-7394-4992-a7cc-e29767c7e129 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1300 microversion: 2.1 time: 0.291398 Aug 31 10:57:09.636596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 210/451] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:09 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:09.651393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:09.652010 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:09.658327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:09.658823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:09.659263 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:09.659962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:09.660449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:09.660856 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:09.688331 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:09.696857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:09.698417 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:09.699582 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e324ae54-d436-45d5-bd01-efdea36f0789 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.481922 Aug 31 10:57:09.700109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 242/452] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:09 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:09.801368 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:09.809903 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e3e9ed92-dffa-418b-ad7c-1a0983d03f56 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.162349 Aug 31 10:57:09.810849 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 211/453] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:09 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:10.176525 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:10.177062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:10.183853 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.184345 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.184764 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.185483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.185964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.186686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.188842 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:10.189464 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:10.195969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.196504 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.196865 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.197545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.198858 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.386499 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:10.393957 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:10.394940 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ce517aae-232d-45c6-a0ba-3bba6828a85c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1556 microversion: 2.1 time: 0.222366 Aug 31 10:57:10.395546 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 243/454] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:10 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1556 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:10.400363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b30b2568-0cf0-42bf-b099-119ae1ae7001 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "717902b9-3aef-436a-97cf-9ab12af3f43f"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:10.402249 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-89b4d337-0b45-47aa-a07d-a67c0bbc3fe8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.217367 Aug 31 10:57:10.403089 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b30b2568-0cf0-42bf-b099-119ae1ae7001 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:10.403231 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 212/455] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:10 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:10.409217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b30b2568-0cf0-42bf-b099-119ae1ae7001 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.409809 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b30b2568-0cf0-42bf-b099-119ae1ae7001 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.410202 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b30b2568-0cf0-42bf-b099-119ae1ae7001 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.411139 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b30b2568-0cf0-42bf-b099-119ae1ae7001 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.411592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b30b2568-0cf0-42bf-b099-119ae1ae7001 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.412019 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b30b2568-0cf0-42bf-b099-119ae1ae7001 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.419123 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-146ca88a-495f-4521-b901-4cd79efc2a98 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:10.419587 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-146ca88a-495f-4521-b901-4cd79efc2a98 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:10.425971 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-146ca88a-495f-4521-b901-4cd79efc2a98 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.426501 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-146ca88a-495f-4521-b901-4cd79efc2a98 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.426958 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-146ca88a-495f-4521-b901-4cd79efc2a98 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.427588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-146ca88a-495f-4521-b901-4cd79efc2a98 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.428038 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-146ca88a-495f-4521-b901-4cd79efc2a98 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.428458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-146ca88a-495f-4521-b901-4cd79efc2a98 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.506928 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-146ca88a-495f-4521-b901-4cd79efc2a98 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091667 Aug 31 10:57:10.507527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 213/456] 10.222.0.75 () {58 vars in 1275 bytes} [Wed Aug 31 10:57:10 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:10.633110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=14 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:10.657011 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:10.657889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:10.664664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.665135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.665625 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.666372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.666813 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.667217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.702436 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.702831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.703262 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.703713 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lazy-loading 'fault' on Instance uuid efcd181a-88d5-40b8-9b8a-1e8fcba6c798 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:57:10.746437 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:10.755282 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f7725ae0-ee97-47d7-8c1a-00cac5210a37 tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1305 microversion: 2.1 time: 0.102320 Aug 31 10:57:10.755875 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 214/457] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:10 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:10.769224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:10.769224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:10.769224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.769224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.769565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.769966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.770421 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.770843 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.910926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:10.919658 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:10.921091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:10.922294 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-696a6453-1b31-4828-b24f-7db7efe34016 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.165440 Aug 31 10:57:10.922892 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 215/458] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:10 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:10.929017 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:10.929017 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:10.935506 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.936003 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.936435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:10.937143 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:10.937595 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:10.938042 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:11.077284 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:11.085358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8e520e7d-57f7-4be0-973f-90a34dcea6e7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.161505 Aug 31 10:57:11.085949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 216/459] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:10 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:11.424658 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:11.425261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:11.430602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b30b2568-0cf0-42bf-b099-119ae1ae7001 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "POST /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033869 Aug 31 10:57:11.431278 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:11.431606 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 244/460] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 10:57:10 2022] POST /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:11.432175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:11.432936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:11.433627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:11.434097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:11.434508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:11.578091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:11.586191 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-372c2058-af03-4f18-929d-4dce036c2fab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.166220 Aug 31 10:57:11.586765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 217/461] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:11 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:11.721879 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-f154e0f1-49a6-4c25-af6e-09ad699c05ff req-9f49f159-24f4-4f10-b50a-7025e7428bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e849d954-3d1f-494d-8394-f6ec1dba55c4", "tag": "62d1ed4c-0d7e-428e-b0b3-580b313c4366"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:11.732029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-f154e0f1-49a6-4c25-af6e-09ad699c05ff req-9f49f159-24f4-4f10-b50a-7025e7428bdd service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:11.732597 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-f154e0f1-49a6-4c25-af6e-09ad699c05ff req-9f49f159-24f4-4f10-b50a-7025e7428bdd service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:11.733087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-f154e0f1-49a6-4c25-af6e-09ad699c05ff req-9f49f159-24f4-4f10-b50a-7025e7428bdd service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:11.746015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-f154e0f1-49a6-4c25-af6e-09ad699c05ff req-9f49f159-24f4-4f10-b50a-7025e7428bdd service nova] Creating event network-changed:62d1ed4c-0d7e-428e-b0b3-580b313c4366 for instance e849d954-3d1f-494d-8394-f6ec1dba55c4 on hv-cinder-79578 Aug 31 10:57:11.750929 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-f154e0f1-49a6-4c25-af6e-09ad699c05ff req-9f49f159-24f4-4f10-b50a-7025e7428bdd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033946 Aug 31 10:57:11.751593 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 245/462] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:11.776469 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:11.777066 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:11.783191 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:11.783669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:11.784091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:11.784770 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:11.785213 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:11.785622 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:11.801130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:11.818077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:11.818554 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:11.818976 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:11.819417 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lazy-loading 'fault' on Instance uuid efcd181a-88d5-40b8-9b8a-1e8fcba6c798 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:57:11.860792 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca28332a4944d5a8d64085e4148b649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dec1e95f67cb4ec48c5741475828db91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:11.868658 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6d483ed3-fc6a-46ed-b381-8e505e3552fa tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 200 len: 1305 microversion: 2.1 time: 0.096029 Aug 31 10:57:11.869254 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 218/463] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:11 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:11.948665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:11.949366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:11.956750 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:11.957277 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:11.957712 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:11.959047 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:11.959502 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:11.959922 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:12.107127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:12.107807 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:12.110340 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:12.120792 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:12.121308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:12.121750 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:12.123092 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:12.124682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:12.125839 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:12.126322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:12.126439 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b0d1ec35-3794-4803-b442-4ce70d2131fe tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.182156 Aug 31 10:57:12.127107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:12.127435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 246/464] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:11 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:12.393356 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:12.403631 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f7fde644-6a89-475e-bfbf-d72e45affb0e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.300507 Aug 31 10:57:12.404584 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 219/465] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:12 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:57:12.607557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:12.608237 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:12.616177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:12.616670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:12.617114 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:12.617877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:12.618671 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:12.619313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:12.889249 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:12.890266 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:12.891405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] [instance: efcd181a-88d5-40b8-9b8a-1e8fcba6c798] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:12.898010 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:12.898795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:12.899342 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-96f2ce21-bb47-4176-9fe9-60ba2f39439c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.295975 Aug 31 10:57:12.899651 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:12.899995 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 247/466] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:12 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:57:12.900961 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:12.901482 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:12.902059 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:12.917899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] HTTP exception thrown: Instance efcd181a-88d5-40b8-9b8a-1e8fcba6c798 could not be found. Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Request method failure captured: Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 HTTP/1.1 Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz5YGL8AlqofcFoDGfHk62Y0JtA8erznfuRRsPzCOx7oYl2eaA0eoAADmJmuNJF9cS9tEBzjrGAxNz6bpL3VX2IqilyJRkLTpnBBRgFTKJLBBWy2LNS8ccekTaFrCyRJHZufSI_tifFE_u4SX3H51a72dtFCrGLdwzbhIZEBApk-PzY Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: dec1e95f67cb4ec48c5741475828db91 Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-VolumesNegativeTest-1051385980 Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 10:57:12.920086 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dec1e95f67cb4ec48c5741475828db91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dec1e95f67cb4ec48c5741475828db91"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dec1e95f67cb4ec48c5741475828db91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dec1e95f67cb4ec48c5741475828db91"}]}] Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-VolumesNegativeTest-1051385980 Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: dec1e95f67cb4ec48c5741475828db91 Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-VolumesNegativeTest-1051385980 Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-VolumesNegativeTest-1051385980-project Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 9ca28332a4944d5a8d64085e4148b649 Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-VolumesNegativeTest-1051385980-project Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance efcd181a-88d5-40b8-9b8a-1e8fcba6c798 could not be found. Aug 31 10:57:12.921441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'efcd181a-88d5-40b8-9b8a-1e8fcba6c798'} Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efcd181a-88d5-40b8-9b8a-1e8fcba6c798 could not be found. Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:57:12.922200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efcd181a-88d5-40b8-9b8a-1e8fcba6c798 could not be found. Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efcd181a-88d5-40b8-9b8a-1e8fcba6c798 could not be found. Aug 31 10:57:12.923616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:57:12.926308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] Returning 404 to user: Instance efcd181a-88d5-40b8-9b8a-1e8fcba6c798 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:57:12.927389 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bad9be53-667d-41cb-acdc-131d74c3bd1c tempest-VolumesNegativeTest-1051385980 tempest-VolumesNegativeTest-1051385980-project] 10.222.0.75 "GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798" status: 404 len: 111 microversion: 2.1 time: 0.041981 Aug 31 10:57:12.928424 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 220/467] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:12 2022] GET /compute/v2.1/servers/efcd181a-88d5-40b8-9b8a-1e8fcba6c798 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 10:57:13.151013 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:13.151616 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:13.158554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:13.159019 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:13.159439 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:13.160123 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:13.160563 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:13.160978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:13.323111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:13.332000 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:13.333863 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:13.334628 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1e80c5b3-a271-401a-865a-68585031b575 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.187766 Aug 31 10:57:13.340833 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 248/468] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:13 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:13.424877 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:13.425489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:13.431825 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:13.432304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:13.433276 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:13.434004 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:13.434497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:13.434939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:13.569112 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:13.581825 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e5f15807-41ef-40c6-849c-ab218dba615e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.161214 Aug 31 10:57:13.582612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 221/469] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:13 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:13.920794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:13.921458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:13.928126 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:13.928709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:13.929042 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:13.929734 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:13.930242 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:13.930660 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:14.069756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:14.079302 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-13b66635-5a86-460e-9e87-65a378c1aa1c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.162782 Aug 31 10:57:14.080436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 249/470] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:13 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:14.357425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:14.358827 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:14.364601 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:14.365110 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:14.365538 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:14.366255 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:14.366701 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:14.367122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:14.511981 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:14.522189 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:14.523626 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:14.525500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-31fbd67d-cf70-497b-86ae-f1aa6c3cf350 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.171919 Aug 31 10:57:14.526317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 222/471] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:14 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:14.603075 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:14.603718 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:14.610677 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:14.611138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:14.611895 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:14.612604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:14.613057 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:14.613493 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:14.759293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:14.767234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-aa9b1be0-cc7e-4c51-9c63-e9d9400df717 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.168732 Aug 31 10:57:14.768412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 250/472] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:14 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:14.904487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-04529488-e514-4864-8d29-ae9d2e9e2ec6 req-640179dd-ebef-4a58-b48e-a6d78630f280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2336d69f-d13a-4040-bd92-5549daa38d82", "name": "network-vif-plugged", "status": "completed", "tag": "626f67f7-9109-4add-8ced-00a8ba6b25da"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:14.918714 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-04529488-e514-4864-8d29-ae9d2e9e2ec6 req-640179dd-ebef-4a58-b48e-a6d78630f280 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:14.919194 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-04529488-e514-4864-8d29-ae9d2e9e2ec6 req-640179dd-ebef-4a58-b48e-a6d78630f280 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:14.919739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-04529488-e514-4864-8d29-ae9d2e9e2ec6 req-640179dd-ebef-4a58-b48e-a6d78630f280 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:14.937014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-04529488-e514-4864-8d29-ae9d2e9e2ec6 req-640179dd-ebef-4a58-b48e-a6d78630f280 service nova] Creating event network-vif-plugged:626f67f7-9109-4add-8ced-00a8ba6b25da for instance 2336d69f-d13a-4040-bd92-5549daa38d82 on hv-cinder-79578 Aug 31 10:57:14.943434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-04529488-e514-4864-8d29-ae9d2e9e2ec6 req-640179dd-ebef-4a58-b48e-a6d78630f280 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043131 Aug 31 10:57:14.943734 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 223/473] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:15.100533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:15.101615 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:15.108324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:15.108852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:15.109347 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:15.110165 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:15.110836 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:15.111784 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:15.304942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:15.314032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-627dd059-173c-4785-82ba-f7d2583be8ec tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.217843 Aug 31 10:57:15.314701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 251/474] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:15 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:15.549186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:15.550232 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:15.558763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:15.559287 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:15.559759 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:15.560562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:15.560920 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:15.561343 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:15.754719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:15.763445 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:15.765104 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:15.766561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-54fe7796-a6b6-40e3-bd4a-6822b83b3e70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.221837 Aug 31 10:57:15.767030 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 224/475] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:15 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:15.788366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:15.788973 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:15.795463 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:15.795958 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:15.796389 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:15.797076 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:15.797525 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:15.797979 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:15.938170 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:15.946356 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5c2f30cf-0e18-4c6a-9d94-7596cf589077 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.161779 Aug 31 10:57:15.946936 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 252/476] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:15 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:16.335426 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:16.336083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:16.342568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:16.343049 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:16.343492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:16.344253 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:16.344699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:16.345122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:16.574694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:16.583149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d32690e5-4392-418c-9ba6-ab6509b4dd54 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.251756 Aug 31 10:57:16.583699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 225/477] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:16 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:16.790954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:16.792151 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:16.800287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:16.800774 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:16.801430 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:16.802185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:16.802646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:16.803071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:16.809077 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:16.946544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:16.955723 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:16.957178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:16.958458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6fc4a884-357d-493d-828f-f206eb7fa644 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.173715 Aug 31 10:57:16.959593 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 253/478] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:16 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:16.971321 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-b4b2eeec-50aa-4d24-8547-7142fa676184 req-2cb97698-eb70-4d99-a60b-c2f5205cafc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80088fbb-9cea-4ee2-8224-ec783c4f9397", "name": "network-vif-plugged", "status": "completed", "tag": "64257485-56f5-4b89-a0a9-09ac5a18b844"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:16.971800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:16.972723 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:16.980056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:16.980559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:16.981004 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:16.981730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:16.982209 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:16.982338 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-b4b2eeec-50aa-4d24-8547-7142fa676184 req-2cb97698-eb70-4d99-a60b-c2f5205cafc3 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:16.982728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-b4b2eeec-50aa-4d24-8547-7142fa676184 req-2cb97698-eb70-4d99-a60b-c2f5205cafc3 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:16.982959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:16.983150 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-b4b2eeec-50aa-4d24-8547-7142fa676184 req-2cb97698-eb70-4d99-a60b-c2f5205cafc3 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:16.995052 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-b4b2eeec-50aa-4d24-8547-7142fa676184 req-2cb97698-eb70-4d99-a60b-c2f5205cafc3 service nova] Creating event network-vif-plugged:64257485-56f5-4b89-a0a9-09ac5a18b844 for instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 on hv-cinder-79578 Aug 31 10:57:17.000103 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-b4b2eeec-50aa-4d24-8547-7142fa676184 req-2cb97698-eb70-4d99-a60b-c2f5205cafc3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032586 Aug 31 10:57:17.000702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 226/479] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:17.130158 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:17.137981 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-dece2a72-ed32-430f-9c69-3b2c45ea69ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.170585 Aug 31 10:57:17.138646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 254/480] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:16 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:17.605283 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:17.606111 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:17.612894 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:17.613385 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:17.613904 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:17.614561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:17.615013 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:17.615455 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:17.758969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:17.767079 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5c06b621-bba9-431b-9924-ea1d38626d2d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1318 microversion: 2.1 time: 0.166487 Aug 31 10:57:17.767638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 227/481] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:17 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:17.983444 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:17.988177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:17.996296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:17.997670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:17.998441 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:17.999799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:18.001021 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:18.001982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:18.137392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:18.145912 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:18.147358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:18.148539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8b9a543c-074f-4a18-bba6-d4aad6219ac7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.169816 Aug 31 10:57:18.149199 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 255/482] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:17 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:18.158744 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:18.159409 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:18.165441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:18.165962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:18.166391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:18.167137 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:18.167643 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:18.168066 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:18.309704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:18.318004 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c6f50713-d50c-4853-88cf-b8765839a636 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.163226 Aug 31 10:57:18.318576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 228/483] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:18 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:18.789419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:18.790498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:18.792955 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=6 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:18.798362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:18.798854 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:18.799611 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:18.800576 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:18.801069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:18.801503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:19.006438 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:19.015202 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5cc2eb32-c828-486e-9cb2-0abed209dfcf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1507 microversion: 2.1 time: 0.230912 Aug 31 10:57:19.016038 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 256/484] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:18 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:19.171592 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:19.173072 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:19.175414 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:19.190124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:19.193246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:19.193933 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:19.194827 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:19.195441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:19.196001 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:19.339771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:19.340300 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:19.346797 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:19.347514 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:19.348119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:19.349087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:19.349696 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:19.350315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:19.626900 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:19.642202 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:19.643923 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:19.645667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9309cda1-2fda-4798-9b89-0aa070ed7c14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.478775 Aug 31 10:57:19.646808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 229/485] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:19 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:19.724543 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:19.735153 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1a584d3d-31ef-487b-b0cc-cae8024d7655 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.399261 Aug 31 10:57:19.735955 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 257/486] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:19 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:57:20.201823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:20.202483 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:20.208835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:20.209579 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:20.210050 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:20.210765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:20.211372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:20.211956 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:20.403057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:20.412660 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e33ea583-b0f9-4ac2-8c83-3a166a597354 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1595 microversion: 2.1 time: 0.214927 Aug 31 10:57:20.413503 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 230/487] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:20 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1595 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:20.668874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:20.670304 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:20.678056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:20.678733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:20.679331 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:20.680363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:20.681157 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:20.682042 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:20.757530 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:20.758217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:20.766676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:20.768994 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:20.770468 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:20.772929 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:20.773711 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:20.776040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:21.107939 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:21.114651 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:21.119336 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:21.121934 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:21.123683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-07baee37-42cd-44b3-a51b-4f23a03bcc94 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.458913 Aug 31 10:57:21.124893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 258/488] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:20 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:21.127910 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-99b6d88f-62c8-4a25-a099-cdbbad42c9a0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.375168 Aug 31 10:57:21.129072 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 231/489] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:20 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:22.154948 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:22.158278 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:22.159777 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:22.160948 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:22.173903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:22.176012 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:22.176680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:22.177436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:22.178072 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:22.178670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:22.179574 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:22.180454 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:22.181068 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:22.181714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:22.182339 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:22.183325 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:22.445304 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:22.452570 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:22.457990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-72268544-5cec-483c-ab5d-0be1811b9669 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1371 microversion: 2.1 time: 0.311497 Aug 31 10:57:22.459407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 259/490] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:22 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:22.476219 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:22.478622 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:22.479957 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c3dd916e-c923-46df-a00b-075b32b7f5d1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.333039 Aug 31 10:57:22.480898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 232/491] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:22 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:23.479661 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:23.480348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:23.491198 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:23.491685 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:23.492118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:23.492844 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:23.493322 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:23.493951 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:23.504990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:23.505600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:23.512566 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:23.515263 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:23.516228 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:23.517282 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:23.517972 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:23.518855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:23.821429 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:23.835377 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:23.867744 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:23.870183 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f4803bc5-3093-40fc-a506-4605080526fc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1564 microversion: 2.1 time: 0.393604 Aug 31 10:57:23.871444 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 260/492] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:23 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1564 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:23.871586 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:23.872793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3cdbdf4f-2c3f-4762-b657-8ac5e04476f7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.373491 Aug 31 10:57:23.873335 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 233/493] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:23 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:23.891085 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-e426e50e-17f5-40af-8dff-9ab3e22b39fc req-ec1a0baf-290e-4c11-9d84-041247453dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c57211-e6e0-4f67-9029-1806387921e7", "tag": "ad172ad1-ff5a-4d9c-8473-07c7509a5e88"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:23.895963 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b8fe197a-0884-4033-b70a-aae378e91f54 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:23.905384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b8fe197a-0884-4033-b70a-aae378e91f54 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:23.913864 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8fe197a-0884-4033-b70a-aae378e91f54 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:23.914637 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8fe197a-0884-4033-b70a-aae378e91f54 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:23.915243 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8fe197a-0884-4033-b70a-aae378e91f54 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:23.916123 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8fe197a-0884-4033-b70a-aae378e91f54 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:23.916985 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8fe197a-0884-4033-b70a-aae378e91f54 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:23.917661 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8fe197a-0884-4033-b70a-aae378e91f54 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:23.921580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-e426e50e-17f5-40af-8dff-9ab3e22b39fc req-ec1a0baf-290e-4c11-9d84-041247453dd5 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:23.923069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-e426e50e-17f5-40af-8dff-9ab3e22b39fc req-ec1a0baf-290e-4c11-9d84-041247453dd5 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:23.925272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-e426e50e-17f5-40af-8dff-9ab3e22b39fc req-ec1a0baf-290e-4c11-9d84-041247453dd5 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:23.960528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-e426e50e-17f5-40af-8dff-9ab3e22b39fc req-ec1a0baf-290e-4c11-9d84-041247453dd5 service nova] Creating event network-changed:ad172ad1-ff5a-4d9c-8473-07c7509a5e88 for instance c6c57211-e6e0-4f67-9029-1806387921e7 on hv-cinder-79578 Aug 31 10:57:23.975915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-e426e50e-17f5-40af-8dff-9ab3e22b39fc req-ec1a0baf-290e-4c11-9d84-041247453dd5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102764 Aug 31 10:57:23.982127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 261/494] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:24.080518 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b8fe197a-0884-4033-b70a-aae378e91f54 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191685 Aug 31 10:57:24.088269 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 234/495] 10.222.0.75 () {58 vars in 1275 bytes} [Wed Aug 31 10:57:23 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:24.901706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:24.903155 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:24.914800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:24.916629 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:24.917626 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:24.920393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:24.921625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:24.922369 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:25.173630 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:25.183496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:25.185894 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:25.187770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-bb08a50b-06ed-40bb-aba1-25b07b2e67dd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.293496 Aug 31 10:57:25.193109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 262/496] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:24 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:26.094124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1509503643"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:26.094742 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:26.101318 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:26.102270 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:26.102890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:26.103607 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:26.104394 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:26.104662 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:26.218287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:26.220067 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:26.239683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:26.240380 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:26.240979 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:26.241986 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:26.243321 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:26.244282 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:26.363165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.network.security_group_api [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Adding security group 8b5458d0-0185-4f91-8efd-28cb5528b0d2 to port ad172ad1-ff5a-4d9c-8473-07c7509a5e88 Aug 31 10:57:26.576997 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:26.590448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:26.592558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:26.596272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8b6b3fde-225c-4641-a1ee-8c25e897ce02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.383974 Aug 31 10:57:26.605957 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 263/497] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:26 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:26.624700 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-bdfa7e97-150f-40ef-94e1-f0555774a84a req-e4ce2b1c-6233-4f72-bcae-9891b4f34813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80088fbb-9cea-4ee2-8224-ec783c4f9397", "tag": "64257485-56f5-4b89-a0a9-09ac5a18b844"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:26.643234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-bdfa7e97-150f-40ef-94e1-f0555774a84a req-e4ce2b1c-6233-4f72-bcae-9891b4f34813 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:26.643725 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-bdfa7e97-150f-40ef-94e1-f0555774a84a req-e4ce2b1c-6233-4f72-bcae-9891b4f34813 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:26.644149 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-bdfa7e97-150f-40ef-94e1-f0555774a84a req-e4ce2b1c-6233-4f72-bcae-9891b4f34813 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:26.664899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-bdfa7e97-150f-40ef-94e1-f0555774a84a req-e4ce2b1c-6233-4f72-bcae-9891b4f34813 service nova] Creating event network-changed:64257485-56f5-4b89-a0a9-09ac5a18b844 for instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 on hv-cinder-79578 Aug 31 10:57:26.674237 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-bdfa7e97-150f-40ef-94e1-f0555774a84a req-e4ce2b1c-6233-4f72-bcae-9891b4f34813 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066835 Aug 31 10:57:26.675135 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 264/498] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:27.037632 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-207c676e-e176-4c40-8c13-ccb36870383b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "POST /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/action" status: 202 len: 0 microversion: 2.1 time: 0.945272 Aug 31 10:57:27.037632 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 235/499] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:57:26 2022] POST /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/action => generated 0 bytes in 947 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:57:27.044341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:27.045036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:27.064549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:27.065048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:27.065478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:27.067089 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:27.067547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:27.067970 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:27.392782 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-2c1a7201-2445-4b56-b8d7-dec04e71a9c0 req-195edd48-a1da-4d28-aaec-f00647bdf0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c57211-e6e0-4f67-9029-1806387921e7", "tag": "ad172ad1-ff5a-4d9c-8473-07c7509a5e88"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:27.411389 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-2c1a7201-2445-4b56-b8d7-dec04e71a9c0 req-195edd48-a1da-4d28-aaec-f00647bdf0c1 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:27.415459 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-2c1a7201-2445-4b56-b8d7-dec04e71a9c0 req-195edd48-a1da-4d28-aaec-f00647bdf0c1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:27.416903 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-2c1a7201-2445-4b56-b8d7-dec04e71a9c0 req-195edd48-a1da-4d28-aaec-f00647bdf0c1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:27.448220 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-2c1a7201-2445-4b56-b8d7-dec04e71a9c0 req-195edd48-a1da-4d28-aaec-f00647bdf0c1 service nova] Creating event network-changed:ad172ad1-ff5a-4d9c-8473-07c7509a5e88 for instance c6c57211-e6e0-4f67-9029-1806387921e7 on hv-cinder-79578 Aug 31 10:57:27.464842 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-2c1a7201-2445-4b56-b8d7-dec04e71a9c0 req-195edd48-a1da-4d28-aaec-f00647bdf0c1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076456 Aug 31 10:57:27.465922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 236/500] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:27.641128 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:27.651668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:27.662699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:27.663642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:27.664353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:27.665808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:27.667429 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:27.668744 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:27.762339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:27.779260 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8db4c51b-6bbb-4947-a440-1174a713f34c tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1760 microversion: 2.1 time: 0.739093 Aug 31 10:57:27.779860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 265/501] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:27 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1760 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:27.950363 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:27.961633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:27.963598 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:27.966506 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bd3172b5-eece-449a-bbdb-0577a6b17897 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.347265 Aug 31 10:57:27.967667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 237/502] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:27 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:29.000238 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:29.001101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:29.010541 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:29.011511 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:29.012186 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:29.013296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:29.014061 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:29.014701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:29.249476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:29.265587 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:29.269849 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:29.272672 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-386f2d1e-ea81-4b96-9289-141e1da90330 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1744 microversion: 2.20 time: 0.284459 Aug 31 10:57:29.274124 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 266/503] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:28 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1744 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:57:30.300655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:30.302070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:30.317890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:30.318689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:30.319274 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:30.320166 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:30.320782 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:30.321356 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:30.324848 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:30.585121 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:30.600694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:30.602230 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:30.603384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4a526d54-9374-48e6-adb9-04b92800b015 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1744 microversion: 2.20 time: 0.306783 Aug 31 10:57:30.603959 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 238/504] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:30 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1744 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:31.633510 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:31.634790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:31.650783 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:31.653559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:31.654264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:31.655531 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:31.656149 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:31.656742 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:32.013170 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:32.050874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:32.058405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:32.060112 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-fa6fb369-f97b-4870-a20d-468f6ace8355 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1744 microversion: 2.20 time: 0.436620 Aug 31 10:57:32.060559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 267/505] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:31 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1744 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:32.530587 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-48400176-067a-4f83-97bf-a89c03ed9061 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Action: 'create', calling method: .version_select at 0x7f37a8e8baf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-499325673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdPYhzKo1cX0GpabN6M99ydvykifTK2rSjoEznHNWQ2uSY3Qt/EpjL8ZOP1IeB9weTszolXdkpJgpLQYz04srFok+74zgDLWkiRLVjiIfFlnBzsvcTAXIwk8ypl5JQ8fw=="}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:32.553531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-48400176-067a-4f83-97bf-a89c03ed9061 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Getting quotas for project 54f6126a98384bd189b960708bb4376e. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:57:32.558083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-48400176-067a-4f83-97bf-a89c03ed9061 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Getting quotas for user d64a3d12f7ae4c8982bdc54b5853b169 and project 54f6126a98384bd189b960708bb4376e. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:57:32.582677 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-48400176-067a-4f83-97bf-a89c03ed9061 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.272087 Aug 31 10:57:32.583730 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 239/506] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 10:57:32 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:32.899592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-1b6b411b-4abf-4b3f-b784-f11f698cb4dc req-30d41ee5-d302-43ac-b7b1-848652673c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fdb0f3-110c-4250-8dcc-e44426464c66", "name": "network-vif-plugged", "status": "completed", "tag": "acef88c9-adeb-44f3-9d0f-359b56141283"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:32.916574 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-1b6b411b-4abf-4b3f-b784-f11f698cb4dc req-30d41ee5-d302-43ac-b7b1-848652673c13 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:32.917048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-1b6b411b-4abf-4b3f-b784-f11f698cb4dc req-30d41ee5-d302-43ac-b7b1-848652673c13 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:32.917470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-1b6b411b-4abf-4b3f-b784-f11f698cb4dc req-30d41ee5-d302-43ac-b7b1-848652673c13 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:32.933515 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-1b6b411b-4abf-4b3f-b784-f11f698cb4dc req-30d41ee5-d302-43ac-b7b1-848652673c13 service nova] Creating event network-vif-plugged:acef88c9-adeb-44f3-9d0f-359b56141283 for instance a8fdb0f3-110c-4250-8dcc-e44426464c66 on hv-cinder-79578 Aug 31 10:57:32.940285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-1b6b411b-4abf-4b3f-b784-f11f698cb4dc req-30d41ee5-d302-43ac-b7b1-848652673c13 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044333 Aug 31 10:57:32.941511 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 268/507] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:33.091417 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:33.092323 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:33.099286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:33.099928 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:33.100444 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:33.101256 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:33.101805 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:33.102354 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:33.316811 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:33.325471 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:33.327137 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:33.328502 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f5764ffa-9535-4f8b-9697-7fe865af2987 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1739 microversion: 2.20 time: 0.244733 Aug 31 10:57:33.329224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 240/508] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:33 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:34.353530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:34.354313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:34.368299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:34.372055 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:34.373026 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:34.374033 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:34.374754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:34.375407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:34.592087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:34.605091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:34.611811 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:34.613958 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ae8d8cc4-fac6-48de-9625-8c71fed67cb4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1739 microversion: 2.20 time: 0.264625 Aug 31 10:57:34.615604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 269/509] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:34 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:35.641258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:35.641985 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:35.653154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:35.654005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:35.654632 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:35.655592 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:35.656277 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:35.656856 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:35.857101 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:35.866440 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:35.868272 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:35.869943 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-48755721-5b03-4e77-a6c2-89243de84d68 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1739 microversion: 2.20 time: 0.233400 Aug 31 10:57:35.870553 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 241/510] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:35 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:36.899680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:36.901086 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:36.914515 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:36.915509 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:36.916111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:36.916983 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:36.917653 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:36.918473 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:37.139093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:37.148290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:37.149710 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:37.151189 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9e58f106-80f5-44cc-ad8d-510e8e30f682 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1739 microversion: 2.20 time: 0.255536 Aug 31 10:57:37.151754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 270/511] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:36 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:38.175176 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:38.175791 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:38.185443 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:38.185691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:38.191916 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:38.192729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:38.193216 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:38.193658 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:38.405270 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:38.418470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:38.420040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:38.421313 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-91ab710c-98b5-4c7c-9468-7bde376d07e8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1739 microversion: 2.20 time: 0.250472 Aug 31 10:57:38.421981 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 242/512] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:38 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:39.446675 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:39.448109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:39.451287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=62 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:39.457119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:39.457981 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:39.458482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:39.459271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:39.459728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:39.460147 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:39.629496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:39.633075 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=100 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:39.645810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:39.647232 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:39.648553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2ee8f3c0-ca83-4cd9-bfec-ee9ed56afc3e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1739 microversion: 2.20 time: 0.206011 Aug 31 10:57:39.649430 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 271/513] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:39 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:40.676035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:40.676643 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:40.690526 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:40.691431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:40.692190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:40.694081 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:40.694640 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:40.695066 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:40.889120 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:40.899463 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:40.901682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:40.903312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6c81a9c3-94ce-41b7-b6c2-3d4b71f97125 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1739 microversion: 2.20 time: 0.231526 Aug 31 10:57:40.903873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 243/514] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:40 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:41.928513 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:41.929261 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:41.938772 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:41.939565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:41.940197 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:41.941061 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:41.941670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:41.942111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:42.125352 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:42.134489 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:42.136463 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:42.138109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b9b47d9b-d643-4d39-bfed-55671dee227f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1739 microversion: 2.20 time: 0.214129 Aug 31 10:57:42.138967 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 272/515] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:41 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:43.165702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:43.166733 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:43.169381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=4 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:43.175922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:43.176414 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:43.176837 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:43.177534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:43.178004 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:43.178413 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:43.655126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:43.663435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:43.664862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:43.666051 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7be1bc89-609b-4449-a273-40002a5d38de tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1721 microversion: 2.20 time: 0.506821 Aug 31 10:57:43.666609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 244/516] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:43 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1721 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:44.689183 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:44.690021 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:44.696945 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:44.697464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:44.697934 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:44.698675 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:44.699201 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:44.699627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:44.843412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:44.860901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:44.862372 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:44.863562 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4eb280bb-3f6b-4b7a-9ac9-4c218e90bb35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1721 microversion: 2.20 time: 0.178432 Aug 31 10:57:44.864123 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 273/517] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:44 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:45.886960 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:45.887622 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:45.894917 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:45.895430 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:45.895859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:45.896582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:45.897039 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:45.897454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:46.032764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:46.041084 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:46.042552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:46.043803 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d1fd940d-d91d-41de-9370-2b7b8e5fa8db tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1721 microversion: 2.20 time: 0.160817 Aug 31 10:57:46.044412 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 245/518] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:45 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:46.850359 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-d5a99b1c-6299-4d4b-a2e7-6e4df54d4b3d req-413a635d-fe91-4434-9b83-5fdc1e30dad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fdb0f3-110c-4250-8dcc-e44426464c66", "name": "network-vif-unplugged", "status": "completed", "tag": "acef88c9-adeb-44f3-9d0f-359b56141283"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:46.861154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-d5a99b1c-6299-4d4b-a2e7-6e4df54d4b3d req-413a635d-fe91-4434-9b83-5fdc1e30dad8 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:46.861753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-d5a99b1c-6299-4d4b-a2e7-6e4df54d4b3d req-413a635d-fe91-4434-9b83-5fdc1e30dad8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:46.862330 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-d5a99b1c-6299-4d4b-a2e7-6e4df54d4b3d req-413a635d-fe91-4434-9b83-5fdc1e30dad8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:46.876686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-d5a99b1c-6299-4d4b-a2e7-6e4df54d4b3d req-413a635d-fe91-4434-9b83-5fdc1e30dad8 service nova] Creating event network-vif-unplugged:acef88c9-adeb-44f3-9d0f-359b56141283 for instance a8fdb0f3-110c-4250-8dcc-e44426464c66 on hv-cinder-79578 Aug 31 10:57:46.881737 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-d5a99b1c-6299-4d4b-a2e7-6e4df54d4b3d req-413a635d-fe91-4434-9b83-5fdc1e30dad8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035838 Aug 31 10:57:46.882370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 274/519] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:47.067737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:47.068346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:47.074514 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:47.074995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:47.075404 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:47.076303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:47.076750 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:47.077160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:47.214434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:47.222926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:47.224366 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:47.225556 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-42702ba7-4e68-4db0-ba18-7d0b3db6790f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1724 microversion: 2.20 time: 0.161938 Aug 31 10:57:47.226177 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 246/520] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:47 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:47.248679 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-dc8e5c96-ab85-45fc-aae5-5dc4d3eb0daa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4e39e8a-5d7e-4b64-89a3-a8f6465a5eac"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:47.251150 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-dc8e5c96-ab85-45fc-aae5-5dc4d3eb0daa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:47.257548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dc8e5c96-ab85-45fc-aae5-5dc4d3eb0daa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:47.258078 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dc8e5c96-ab85-45fc-aae5-5dc4d3eb0daa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:47.258506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dc8e5c96-ab85-45fc-aae5-5dc4d3eb0daa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:47.259201 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dc8e5c96-ab85-45fc-aae5-5dc4d3eb0daa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:47.259646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dc8e5c96-ab85-45fc-aae5-5dc4d3eb0daa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:47.260063 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dc8e5c96-ab85-45fc-aae5-5dc4d3eb0daa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:47.577652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-dc8e5c96-ab85-45fc-aae5-5dc4d3eb0daa tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.333608 Aug 31 10:57:47.578585 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 275/521] 10.222.0.75 () {62 vars in 1364 bytes} [Wed Aug 31 10:57:47 2022] POST /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments => generated 188 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:57:47.722884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:47.725273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:47.736939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:47.737567 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:47.738111 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:47.738871 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:47.739324 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:47.739754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:47.796893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120481) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 10:57:47.877304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-638a615b-e1ce-444f-b21a-b41492da66ba tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/action" status: 202 len: 0 microversion: 2.20 time: 0.158523 Aug 31 10:57:47.878161 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 247/522] 10.222.0.75 () {62 vars in 1319 bytes} [Wed Aug 31 10:57:47 2022] POST /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:57:47.887276 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:47.889015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:47.897081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:47.897621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:47.898189 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:47.899247 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:47.899886 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:47.900448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:48.047105 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:48.056310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:48.058488 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:48.059709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c3149272-9ee7-422a-9233-feb724b3922f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1750 microversion: 2.20 time: 0.177362 Aug 31 10:57:48.060277 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 276/523] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:47 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:57:48.845124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2852efa7-9620-40af-b96a-c79250124387 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c8d6d7e-c844-4a52-a223-5d1c3aad6f9b", "device": "/dev/sdb"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:48.848673 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2852efa7-9620-40af-b96a-c79250124387 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:48.855521 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2852efa7-9620-40af-b96a-c79250124387 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:48.856006 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2852efa7-9620-40af-b96a-c79250124387 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:48.856519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2852efa7-9620-40af-b96a-c79250124387 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:48.857434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2852efa7-9620-40af-b96a-c79250124387 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:48.857960 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2852efa7-9620-40af-b96a-c79250124387 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:48.859025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2852efa7-9620-40af-b96a-c79250124387 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:49.083603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:49.084361 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:49.091614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:49.092103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:49.092529 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:49.093466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:49.094151 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:49.094856 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:49.161489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2852efa7-9620-40af-b96a-c79250124387 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "POST /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321299 Aug 31 10:57:49.162258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 248/524] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 10:57:48 2022] POST /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:57:49.241415 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:49.250772 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:49.252348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:49.253549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0cb49ea0-208a-489b-ad26-898dc9db9528 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1752 microversion: 2.20 time: 0.174231 Aug 31 10:57:49.254214 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 277/525] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:49 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:57:50.279387 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:50.280843 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:50.283389 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:50.290635 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:50.291159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:50.291604 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:50.292287 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:50.292814 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:50.293287 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:50.442035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:50.451149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:50.452647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:50.453936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bc8339bf-23cc-454c-bf10-c8c8fdbba0f6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1752 microversion: 2.20 time: 0.180483 Aug 31 10:57:50.454527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 249/526] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:50 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:51.476839 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:51.477446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:51.484735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:51.485220 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:51.485654 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:51.486434 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:51.486879 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:51.487300 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:51.692024 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:51.703372 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:51.704803 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:51.706008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-aefafe3f-7d14-4ed8-a8e4-467cf5dfaf55 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.233194 Aug 31 10:57:51.706584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 278/527] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:51 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:52.731091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:52.731716 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:52.738701 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:52.739188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:52.739619 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:52.740320 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:52.740771 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:52.741188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:52.886434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:52.896051 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:52.897514 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:52.898716 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-728f79c7-5878-4be0-9070-1fc85aec7225 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.173044 Aug 31 10:57:52.899275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 250/528] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:52 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:53.921087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:53.922078 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:53.928652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:53.929132 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:53.929559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:53.930357 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:53.930809 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:53.931227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:54.071730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:54.080825 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:54.082299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:54.083481 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-10164167-3cdb-4c01-b744-7ec9b3b4ec75 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.166789 Aug 31 10:57:54.084048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 279/529] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:53 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:54.959108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1430817705", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-499325673", "security_groups": [{"name": "tempest-secgroup-smoke-1366139296"}], "networks": [{"uuid": "d7df3a76-c5d1-4c36-a33b-032aeba4b6aa"}], "block_device_mapping_v2": [{"uuid": "6ced3f97-e11f-4a11-9fd0-41413cba5055", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:57:55.078122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.network.neutron [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] validate_networks() for [('d7df3a76-c5d1-4c36-a33b-032aeba4b6aa', None, None, None, None, None)] {{(pid=120481) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:57:55.106565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:55.107246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:55.114219 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:55.114703 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:55.115166 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:55.115863 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:55.116313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:55.116735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:55.323985 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:55.333620 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:55.335772 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:55.337128 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0d8ba1cb-e5ba-4eeb-a17a-42e4a51d4389 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.234722 Aug 31 10:57:55.337859 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 280/530] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:55 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:57:55.544678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Flavor limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:57:55.545127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Image limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:57:55.545882 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Flavor pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:57:55.546338 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Image pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:57:55.546901 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:57:55.556281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:55.556906 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:55.557353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:55.558483 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:55.559046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:55.559503 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:55.579685 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Getting quotas for project 54f6126a98384bd189b960708bb4376e. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:57:55.584174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Getting quotas for user d64a3d12f7ae4c8982bdc54b5853b169 and project 54f6126a98384bd189b960708bb4376e. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:57:55.648212 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Going to run 1 instances... {{(pid=120481) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:57:55.650420 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6ced3f97-e11f-4a11-9fd0-41413cba5055',volume_size=None,volume_type=None)] {{(pid=120481) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:57:55.798206 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0d91bf82-3a9c-4153-92d4-5ff5f2508b42 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842969 Aug 31 10:57:55.799707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 251/531] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:57:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:57:55.810799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-656337dc-2253-4af9-9dcd-317d6e1bf7f7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:55.811410 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-656337dc-2253-4af9-9dcd-317d6e1bf7f7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:55.872479 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-656337dc-2253-4af9-9dcd-317d6e1bf7f7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:55.880882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-656337dc-2253-4af9-9dcd-317d6e1bf7f7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1088 microversion: 2.1 time: 0.074532 Aug 31 10:57:55.881583 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 281/532] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:55 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:56.361206 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:56.361997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:56.369048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:56.369578 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:56.370056 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:56.370760 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:56.371228 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:56.371660 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:56.517264 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:56.526333 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:56.527758 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:56.528925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-116c3eac-6c1f-4886-b67d-b375b32d1f74 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.172542 Aug 31 10:57:56.529486 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 252/533] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:56 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:56.903073 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:56.903739 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:56.911071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:56.911563 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:56.911961 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:56.912903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:56.913359 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:56.913810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:56.979239 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:56.987842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b5182f91-ea28-4f1f-be27-e1dc79a841be tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1138 microversion: 2.1 time: 0.088747 Aug 31 10:57:56.988637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 282/534] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:56 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:57.552932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:57.553695 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:57.562030 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:57.562520 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:57.562958 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:57.563667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:57.564126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:57.564735 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:57.703267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:57.723927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:57.725939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:57.727345 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-32b6d53d-abbc-4bdd-b4ef-d7a79fb5c370 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.178689 Aug 31 10:57:57.734756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 253/535] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:57 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:58.009009 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:58.009980 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:58.018186 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:58.018832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:58.019503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:58.020353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:58.020904 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:58.021402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:58.087474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:58.095393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f13e49cd-076a-4a7f-b360-202b573bb79a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1138 microversion: 2.1 time: 0.090394 Aug 31 10:57:58.095976 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 283/536] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:58 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:58.751238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:58.752015 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:58.759060 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:58.759554 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:58.759982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:58.760683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:58.761125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:58.761565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:58.764665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:58.932174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:58.942863 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:58.944279 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:58.945451 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b073ea20-5e36-449d-b3aa-df98831b71f5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.198328 Aug 31 10:57:58.946049 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 254/537] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:58 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:57:59.116529 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:59.117225 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:59.124785 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:59.125302 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:59.125731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:59.126472 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:59.126923 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:59.127353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:59.190891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:57:59.199166 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b9fb5cba-fbba-4a86-a027-be3849c6da3e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1138 microversion: 2.1 time: 0.086603 Aug 31 10:57:59.199749 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 284/538] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:57:59 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:57:59.902878 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:59.903534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:59.911428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:59.911913 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:59.912358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:59.913040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:59.913484 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:59.913931 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:59.969622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:57:59.970356 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:57:59.976676 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:59.977140 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:59.977574 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:57:59.978521 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:57:59.979134 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:57:59.979709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:00.063934 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lazy-loading 'services' on Instance uuid 62fc001e-fe00-44da-8493-aaf6fc2cd297 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:58:00.142718 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:00.156632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:00.158402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:00.159591 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-48ab09d2-7c57-48d6-83e6-0a59add60d0e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.194703 Aug 31 10:58:00.160142 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 285/539] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:57:59 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:58:00.210139 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fe1b84e0-c6e2-4c95-bee8-551a9fdc7e0d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "DELETE /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/os-volume_attachments/286ef2a2-aa57-4a09-b91b-2aef2782d8f9" status: 202 len: 0 microversion: 2.1 time: 0.313652 Aug 31 10:58:00.210922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 255/540] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 10:57:59 2022] DELETE /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/os-volume_attachments/286ef2a2-aa57-4a09-b91b-2aef2782d8f9 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:58:00.219907 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:00.220559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:00.228178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:00.228670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:00.229127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:00.229929 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:00.230387 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:00.234163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:00.327882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:00.343211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ab91d6a8-e4e1-4b6b-9416-064f55cb56ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1138 microversion: 2.1 time: 0.127121 Aug 31 10:58:00.343928 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 286/541] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:00 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1138 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:01.184467 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:01.185147 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:01.191765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:01.192230 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:01.192659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:01.193369 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:01.193906 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:01.194613 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:01.339838 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:01.349528 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:01.351001 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:01.352172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-64c813e3-924d-48be-8a38-b34fd4d1de86 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.172988 Aug 31 10:58:01.366026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 256/542] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:01 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:01.366145 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:01.366145 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:01.372881 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:01.373412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:01.373913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:01.374714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:01.375166 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:01.375589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:01.395115 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:01.446195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:01.455240 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b092db0c-f70e-49d9-9503-f8809fbe4043 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1138 microversion: 2.1 time: 0.094579 Aug 31 10:58:01.455844 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 287/543] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:01 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1138 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:02.376700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:02.378234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:02.385433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:02.386290 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:02.386947 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:02.388187 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:02.388848 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:02.389467 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:02.480208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:02.481827 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:02.490288 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:02.491055 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:02.492072 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:02.493700 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:02.494404 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:02.495049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:02.596324 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:02.599792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:02.605739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:02.607575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:02.608137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6e386b72-9451-46c6-8b27-a5da56d1b85a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1138 microversion: 2.1 time: 0.135681 Aug 31 10:58:02.608788 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 288/544] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:02 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1138 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:02.609186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5ee7c42c-87ad-479b-9e1c-0c1dbf124664 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.236428 Aug 31 10:58:02.610195 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 257/545] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:02 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:03.634424 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:03.635448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:03.637347 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:03.638432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:03.645409 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:03.645919 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:03.646346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:03.646906 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:03.647246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:03.647424 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:03.647693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:03.647834 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:03.648110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:03.648414 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:03.648864 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:03.649282 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:03.717057 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:03.725109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-567e71a5-af8e-4ac3-9732-db5eb2f6382b tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1138 microversion: 2.1 time: 0.097413 Aug 31 10:58:03.725931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 289/546] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:03 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:03.807678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:03.823168 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:03.825471 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:03.827573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e6e33f59-2edc-46a2-aa84-aa375f382aae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.196333 Aug 31 10:58:03.828382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 258/547] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:03 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:04.750359 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:04.751315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:04.759457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:04.759944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:04.760378 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:04.761082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:04.761533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:04.762027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:04.824534 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:04.832941 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-96434bca-230d-4f2d-ae89-66256010718a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1130 microversion: 2.1 time: 0.089218 Aug 31 10:58:04.833529 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 290/548] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:04 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1130 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:04.851729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:04.852366 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:04.858880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:04.859368 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:04.859801 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:04.860496 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:04.860951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:04.861372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:04.992381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:05.001656 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:05.002901 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:05.004104 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-98f6a87e-d17c-4648-9794-dcf3ee225b78 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.156483 Aug 31 10:58:05.004646 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 259/549] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:04 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:05.853565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:05.854227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:05.861401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:05.861914 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:05.862352 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:05.863056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:05.863511 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:05.863987 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:05.879843 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:05.939216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:05.947615 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1419ef5b-7afb-45b9-ac2f-ab4432ea8caa tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1186 microversion: 2.1 time: 0.098064 Aug 31 10:58:05.948174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 291/550] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:05 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1186 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:06.031308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:06.032368 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:06.035617 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.036698 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=6 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:06.048144 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:06.048948 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:06.049698 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:06.050886 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:06.051696 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:06.052165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:06.187550 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:06.196965 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:06.198449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:06.199667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ab546141-a6c9-4242-bffd-42c9bcac13f4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.174892 Aug 31 10:58:06.200239 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 260/551] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:06 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:06.972751 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:06.973715 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:06.981057 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:06.981538 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:06.982014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:06.982708 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:06.983158 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:06.983579 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:07.047399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:07.055415 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-fbc8dff3-d3e5-4eaa-ab4b-d41667cc43c7 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1186 microversion: 2.1 time: 0.089077 Aug 31 10:58:07.055969 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 292/552] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:06 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1186 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:07.223374 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:07.223989 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:07.232411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:07.232912 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:07.233350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:07.234097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:07.234554 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:07.234957 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:07.378423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:07.386575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:07.388075 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:07.389128 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8f494aa3-66e0-4343-a96d-58e879e79708 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.170081 Aug 31 10:58:07.389688 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 261/553] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:07 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:07.727403 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b24398e4-5f70-40fe-a06c-a4bbe2872ae4 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:07.733866 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b24398e4-5f70-40fe-a06c-a4bbe2872ae4 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:07.734355 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b24398e4-5f70-40fe-a06c-a4bbe2872ae4 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:07.734784 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b24398e4-5f70-40fe-a06c-a4bbe2872ae4 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:07.758724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b24398e4-5f70-40fe-a06c-a4bbe2872ae4 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Going to try to stop instance {{(pid=120482) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 10:58:07.808385 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b24398e4-5f70-40fe-a06c-a4bbe2872ae4 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/action" status: 202 len: 0 microversion: 2.1 time: 0.085168 Aug 31 10:58:07.809294 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 293/554] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:58:07 2022] POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:58:07.817984 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:07.818651 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:07.824920 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:07.825383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:07.825984 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:07.826724 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:07.827660 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:07.828090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:07.973462 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:07.982196 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bfd76598-6a1d-4703-81fe-e1a499a112ab tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.168586 Aug 31 10:58:07.982767 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 262/555] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:07 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:08.079532 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:08.080485 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:08.087932 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:08.088454 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:08.088895 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:08.089601 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:08.090091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:08.090517 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:08.160964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:08.168927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-bec6943b-9dfd-40a3-93be-a3aeb510509e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1204 microversion: 2.1 time: 0.095101 Aug 31 10:58:08.169509 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 294/556] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:08 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:08.415492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:08.416077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:08.423394 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:08.424029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:08.424455 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:08.425167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:08.425616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:08.426078 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:08.565106 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:08.576085 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:08.577517 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:08.578716 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9083d6b3-e571-4898-98d1-4db89a37de7e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.169035 Aug 31 10:58:08.579272 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 263/557] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:08 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:09.004091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:09.004705 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:09.011445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:09.011943 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:09.012460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:09.013180 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:09.013635 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:09.014099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:09.155164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:09.163384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-62b0efa8-ea68-45d3-b95c-597bee1f5510 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.163372 Aug 31 10:58:09.163971 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 295/558] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:08 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:09.191150 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:09.191765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:09.197890 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:09.198373 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:09.198807 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:09.199494 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:09.199966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:09.200389 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:09.260553 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:09.268378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-82f50563-38d9-41b6-a87f-d169563de8ac tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1204 microversion: 2.1 time: 0.081121 Aug 31 10:58:09.268937 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 264/559] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:09 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1204 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:09.607053 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:09.608015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:09.611140 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=52 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:09.618484 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:09.618959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:09.619387 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:09.620070 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:09.620513 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:09.620927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:09.755604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:09.769100 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:09.771022 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:09.772728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6c719fad-312a-4ac2-b27c-aeb2b5093271 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.172019 Aug 31 10:58:09.773637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 296/560] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:09 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:10.188612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:10.189656 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:10.198714 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:10.199205 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:10.199636 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:10.200333 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:10.200782 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:10.201206 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:10.288511 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:10.289823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:10.296747 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:10.297230 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:10.297659 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:10.298387 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:10.298836 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:10.299253 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:10.354962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:10.362907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bef346a0-e9a1-4ff8-9109-fff00f129173 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.181483 Aug 31 10:58:10.363444 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 265/561] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:10 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:10.370766 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:10.378842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3890ff76-1cb1-4cbf-9b1f-dd5a6b97c951 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1204 microversion: 2.1 time: 0.094232 Aug 31 10:58:10.379398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 297/562] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:10 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:10.800347 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:10.801242 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:10.811924 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:10.812731 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:10.813449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:10.814641 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:10.815394 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:10.816097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:10.969209 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:10.978378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:10.979854 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:10.981031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0ef4e442-fb98-4d48-8f24-8879429907da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.187720 Aug 31 10:58:10.981605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 266/563] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:10 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:11.385039 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:11.385614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:11.392756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:11.393233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:11.393661 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:11.394403 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:11.394856 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:11.395271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:11.402511 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:11.405186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:11.413715 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:11.414867 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:11.415572 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:11.416511 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:11.417185 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:11.417846 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:11.528788 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:11.537715 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e3eca64b-593e-49e8-9078-9ee5d9dc3313 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1204 microversion: 2.1 time: 0.140759 Aug 31 10:58:11.549958 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 267/564] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:11 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1204 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:11.636220 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:11.645130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b92d3a3f-f7cb-4e7a-b17a-d80a5a33ebe3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.264274 Aug 31 10:58:11.646155 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 298/565] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:11 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:12.005465 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:12.006107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:12.012796 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:12.013570 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:12.014253 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:12.015123 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:12.015893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:12.016594 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:12.224412 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:12.233872 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:12.235251 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:12.236507 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fb29bab0-ba1d-492b-8437-8a60ab46f6a1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.235347 Aug 31 10:58:12.237074 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 268/566] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:11 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:12.431414 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-b5017ba7-19a1-4e50-a66f-de46d4a472a6 req-ece043e0-6403-4b41-a8ea-364ba277bef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91b10cf-8d7d-4896-be69-bc4c8089a324", "tag": "5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:12.441963 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-b5017ba7-19a1-4e50-a66f-de46d4a472a6 req-ece043e0-6403-4b41-a8ea-364ba277bef0 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:12.442433 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-b5017ba7-19a1-4e50-a66f-de46d4a472a6 req-ece043e0-6403-4b41-a8ea-364ba277bef0 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:12.442849 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-b5017ba7-19a1-4e50-a66f-de46d4a472a6 req-ece043e0-6403-4b41-a8ea-364ba277bef0 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:12.454151 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-b5017ba7-19a1-4e50-a66f-de46d4a472a6 req-ece043e0-6403-4b41-a8ea-364ba277bef0 service nova] Creating event network-changed:5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6 for instance c91b10cf-8d7d-4896-be69-bc4c8089a324 on hv-cinder-79578 Aug 31 10:58:12.459133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-b5017ba7-19a1-4e50-a66f-de46d4a472a6 req-ece043e0-6403-4b41-a8ea-364ba277bef0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032073 Aug 31 10:58:12.459764 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 299/567] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:12.562265 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:12.563244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:12.573475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:12.574267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:12.574940 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:12.576014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:12.576701 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:12.577363 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:12.670533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:12.671228 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:12.677733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:12.678251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:12.678683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:12.679475 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:12.679922 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:12.680367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:12.717377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:12.725783 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-805a75ca-59ab-4568-9eb1-8a980086b975 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.169831 Aug 31 10:58:12.726445 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 269/568] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:12 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:12.817866 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:12.828311 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4acb97a5-8704-4b73-8e25-223a96965fd0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.164393 Aug 31 10:58:12.828881 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 300/569] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:12 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:13.264900 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:13.265758 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:13.275066 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:13.275556 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:13.275988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:13.276683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:13.277133 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:13.277554 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:13.280125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:13.421467 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:13.432159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:13.433990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:13.435196 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bf164262-54ad-45ee-bc85-34ffec41684a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.177365 Aug 31 10:58:13.435794 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 270/570] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:13 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:13.750878 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:13.751901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:13.760918 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:13.761403 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:13.761862 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:13.762559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:13.763011 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:13.763439 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:13.850559 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:13.851369 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:13.858273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:13.858759 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:13.859186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:13.859883 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:13.860315 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:13.860952 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:13.898959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:13.907365 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6a671344-5251-4225-84e1-92170d0298c6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.163228 Aug 31 10:58:13.920551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 301/571] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:13 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:13.996747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:14.004845 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-12cb6a78-948a-4389-90ca-633fdc109fa8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.158308 Aug 31 10:58:14.005388 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 271/572] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:13 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:14.459318 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:14.460009 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:14.467299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:14.467839 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:14.468323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:14.469101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:14.469604 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:14.470118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:14.618948 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:14.634475 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:14.635919 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:14.637127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-504f0f29-6d2d-4d77-b622-03e96444b034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.182500 Aug 31 10:58:14.637730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 302/573] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:14 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:14.928750 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:14.929345 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:14.937022 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:14.937510 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:14.937991 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:14.938691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:14.939232 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:14.939726 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:15.028857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:15.029435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:15.036320 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:15.036805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:15.037204 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:15.037971 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:15.038418 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:15.038833 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:15.091982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:15.100124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b3c769bd-553e-420c-934c-f4a91bf5aa54 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.175332 Aug 31 10:58:15.100642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 272/574] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:14 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:15.181667 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:15.186031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:15.192661 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-49f2f12c-3391-420e-8408-ed3565865a56 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.167791 Aug 31 10:58:15.193253 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 303/575] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:15 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:15.347631 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-35e27c84-b53f-42b4-b4dc-e0b907c43b65 req-f552ebc2-ff96-4d8a-9f0e-b891e21468a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fdb0f3-110c-4250-8dcc-e44426464c66", "name": "network-vif-plugged", "status": "completed", "tag": "acef88c9-adeb-44f3-9d0f-359b56141283"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:15.358543 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-35e27c84-b53f-42b4-b4dc-e0b907c43b65 req-f552ebc2-ff96-4d8a-9f0e-b891e21468a7 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:15.359077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-35e27c84-b53f-42b4-b4dc-e0b907c43b65 req-f552ebc2-ff96-4d8a-9f0e-b891e21468a7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:15.359488 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-35e27c84-b53f-42b4-b4dc-e0b907c43b65 req-f552ebc2-ff96-4d8a-9f0e-b891e21468a7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:15.375710 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-35e27c84-b53f-42b4-b4dc-e0b907c43b65 req-f552ebc2-ff96-4d8a-9f0e-b891e21468a7 service nova] Creating event network-vif-plugged:acef88c9-adeb-44f3-9d0f-359b56141283 for instance a8fdb0f3-110c-4250-8dcc-e44426464c66 on hv-cinder-79578 Aug 31 10:58:15.381650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-35e27c84-b53f-42b4-b4dc-e0b907c43b65 req-f552ebc2-ff96-4d8a-9f0e-b891e21468a7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038222 Aug 31 10:58:15.383243 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 273/576] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:15.660802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:15.661421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:15.668964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:15.669469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:15.669951 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:15.670664 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:15.671135 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:15.671612 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:15.802957 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:15.813478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:15.814958 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:15.816145 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1e322191-7836-43f4-93f8-2e14e00bdea3 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.159695 Aug 31 10:58:15.816745 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 304/577] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:15 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:16.122022 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:16.122415 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:16.129204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:16.129787 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:16.130375 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:16.131127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:16.131805 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:16.132425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:16.217411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:16.218080 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:16.224904 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:16.225625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:16.226359 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:16.227250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:16.227770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:16.228225 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:16.437171 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:16.445331 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7d02b5a0-eb36-4eb6-bdae-c490b1c54c38 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.328477 Aug 31 10:58:16.445947 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 274/578] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:16 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:16.470492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:16.478716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1a5c6e90-bfc4-4c69-b7fa-c67e4d699553 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.265928 Aug 31 10:58:16.479348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 305/579] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:16 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:16.842927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:16.843813 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:16.853316 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:16.853803 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:16.854266 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:16.854966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:16.855423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:16.855844 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:16.999542 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:17.012829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:17.014325 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:17.015488 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8016c622-83b2-44ba-9f8b-5d29e362b3ae tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.179374 Aug 31 10:58:17.016258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 275/580] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:16 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:17.466805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:17.467479 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:17.474523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:17.475031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:17.475478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:17.476212 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:17.476688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:17.477128 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:17.499763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:17.500393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:17.507104 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:17.507588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:17.508019 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:17.508839 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:17.509285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:17.509705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:17.661987 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:17.670272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-28cbff49-6cf2-4cb9-8a95-ca9be186551e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.207623 Aug 31 10:58:17.670873 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 306/581] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:17 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:17.689344 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:17.697559 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-885d8d37-16a1-4ebb-86e1-6b2edf9203dc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.201773 Aug 31 10:58:17.698143 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 276/582] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:17 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:18.044373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:18.045352 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:18.055904 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:18.056394 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:18.056858 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:18.057568 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:18.058053 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:18.058829 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:18.200893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:18.209686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:18.211165 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:18.212386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f776093c-bae8-4af4-8f22-4b8eb9ec7d70 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.174798 Aug 31 10:58:18.212972 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 307/583] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:18 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:18.695544 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:18.696542 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:18.707795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:18.708596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:18.709319 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:18.710522 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:18.711281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:18.713641 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:18.718914 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:18.719528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:18.726422 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:18.726845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:18.727289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:18.727999 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:18.728446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:18.728864 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:18.909624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:18.918084 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c18aaf99-92c0-48e2-9e56-59531ba8ffdf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.228846 Aug 31 10:58:18.918563 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 277/584] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:18 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:18.921109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:18.929387 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-76ba1936-b414-4eca-abb3-9a6d6076c896 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.214404 Aug 31 10:58:18.930016 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 308/585] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:18 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:19.240162 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:19.241125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:19.248772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.249267 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.249695 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.250423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.250995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.251415 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.259260 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5e132ad3-92f1-4572-a488-0af102f34588 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:19.261727 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5e132ad3-92f1-4572-a488-0af102f34588 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:19.268293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e132ad3-92f1-4572-a488-0af102f34588 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.268808 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e132ad3-92f1-4572-a488-0af102f34588 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.269244 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e132ad3-92f1-4572-a488-0af102f34588 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.270011 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e132ad3-92f1-4572-a488-0af102f34588 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.270491 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e132ad3-92f1-4572-a488-0af102f34588 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.270916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e132ad3-92f1-4572-a488-0af102f34588 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.347564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5e132ad3-92f1-4572-a488-0af102f34588 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "POST /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/action" status: 202 len: 0 microversion: 2.1 time: 0.092089 Aug 31 10:58:19.348388 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 309/586] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:58:19 2022] POST /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:58:19.357053 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:19.358099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:19.364498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.364984 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.365418 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.366244 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.366798 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.367127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.389743 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:19.399870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:19.401292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:19.402542 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b84fec91-bbdb-4efd-98e8-ffbd73dbb4ec tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.169149 Aug 31 10:58:19.403299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 278/587] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:19 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:19.565521 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:19.573654 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0d7f55c5-19e9-46e0-a3ff-a9e92e5805be tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1752 microversion: 2.1 time: 0.220773 Aug 31 10:58:19.574466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 310/588] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:19 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1752 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:19.757679 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-102c5ac4-8ddd-4d3c-a6d1-987ce8171ab4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:19.758261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-102c5ac4-8ddd-4d3c-a6d1-987ce8171ab4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:19.764297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-102c5ac4-8ddd-4d3c-a6d1-987ce8171ab4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.764779 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-102c5ac4-8ddd-4d3c-a6d1-987ce8171ab4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.765207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-102c5ac4-8ddd-4d3c-a6d1-987ce8171ab4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.765926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-102c5ac4-8ddd-4d3c-a6d1-987ce8171ab4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.766381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-102c5ac4-8ddd-4d3c-a6d1-987ce8171ab4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.766795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-102c5ac4-8ddd-4d3c-a6d1-987ce8171ab4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.790309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-102c5ac4-8ddd-4d3c-a6d1-987ce8171ab4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4/ips" status: 200 len: 149 microversion: 2.1 time: 0.036608 Aug 31 10:58:19.790871 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 279/589] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 10:58:19 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:19.802687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f7962eb-6d8a-4106-8ec0-17728c136436"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:19.805097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:19.811964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.812445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.812882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.813569 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.814046 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.814467 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.900292 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Invalid volume: volume 5f7962eb-6d8a-4106-8ec0-17728c136436 is already attached to instances: 62cc77f5-17ed-46dc-bc9f-a927415fc639 Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: POST /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4/os-volume_attachments HTTP/1.1 Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 74 Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:58:19.902107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {"volumeAttachment": {"volumeId": "5f7962eb-6d8a-4106-8ec0-17728c136436"}} Aug 31 10:58:19.903623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Invalid volume: volume 5f7962eb-6d8a-4106-8ec0-17728c136436 is already attached to instances: 62cc77f5-17ed-46dc-bc9f-a927415fc639 Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'server_id': 'e849d954-3d1f-494d-8394-f6ec1dba55c4', 'body': {'volumeAttachment': {'volumeId': '5f7962eb-6d8a-4106-8ec0-17728c136436'}}} Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5f7962eb-6d8a-4106-8ec0-17728c136436 is already attached to instances: 62cc77f5-17ed-46dc-bc9f-a927415fc639 Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:19.904564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5f7962eb-6d8a-4106-8ec0-17728c136436 is already attached to instances: 62cc77f5-17ed-46dc-bc9f-a927415fc639 Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:19.905990 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:19.907494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:19.907494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:58:19.907494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:58:19.907494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5f7962eb-6d8a-4106-8ec0-17728c136436 is already attached to instances: 62cc77f5-17ed-46dc-bc9f-a927415fc639 Aug 31 10:58:19.907494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:19.907494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 400 to user: Invalid volume: volume 5f7962eb-6d8a-4106-8ec0-17728c136436 is already attached to instances: 62cc77f5-17ed-46dc-bc9f-a927415fc639 {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:58:19.907494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0a4b7310-300d-4dc8-b5e4-a34f789d80d3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105099 Aug 31 10:58:19.909139 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 311/590] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 10:58:19 2022] POST /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 10:58:19.913168 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:19.913925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:19.922061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.922870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.923620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.924419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.924882 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.925305 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.939254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:19.939876 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:19.946062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.946555 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.947006 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.947726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:19.948164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:19.948587 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:19.952216 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:58:20.032432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b1a1eab2-3bf9-4ef4-aaaf-fa9de3e9ede6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 204 len: 0 microversion: 2.1 time: 0.123427 Aug 31 10:58:20.033011 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 280/591] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:58:19 2022] DELETE /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 10:58:20.038908 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:20.039597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:20.045406 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:20.045921 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:20.046353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:20.047040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:20.047488 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:20.047907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:20.098348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:20.106626 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-26fa580f-d1e9-4fc0-a1ff-002628497409 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.171435 Aug 31 10:58:20.107344 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 312/592] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:19 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:20.112245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:20.112859 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:20.118941 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:20.119515 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:20.119942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:20.120634 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:20.121097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:20.121596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:20.228070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:20.237095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f6bdc51d-dda6-41d0-ab2c-c6f28f6e3c93 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.202405 Aug 31 10:58:20.237807 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 281/593] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:20 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:20.282760 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:20.293991 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-276ed0f2-7266-4afd-8434-c7136fa3b4ca tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1681 microversion: 2.1 time: 0.184387 Aug 31 10:58:20.294606 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 313/594] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:20 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:20.426870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:20.427466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:20.434025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:20.435583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:20.436077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:20.436493 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:20.437216 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:20.437820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:20.438226 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:20.596841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:20.597448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:20.602035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:20.603849 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:20.604416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:20.604847 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:20.605596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:20.606103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:20.606522 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:20.611717 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:20.613218 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:20.614510 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-25cc0ee6-f060-4bc2-8897-f0ce84d567c0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.191979 Aug 31 10:58:20.615383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 282/595] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:20 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:20.775079 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:20.783962 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-03f80bb0-8f69-43be-86d9-75bfa554219b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1752 microversion: 2.1 time: 0.191743 Aug 31 10:58:20.784462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 314/596] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:20 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1752 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:21.131571 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:21.132262 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:21.139104 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.139578 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.140008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:21.140699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.141211 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.141626 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:21.258693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:21.259445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:21.266219 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.266713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.267178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:21.267877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.268355 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.268781 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:21.290516 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:21.299478 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6de357ae-d2bd-4956-8ac7-0481c1c7785f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.174821 Aug 31 10:58:21.300053 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 283/597] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:21 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:21.316603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:21.317243 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:21.323582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.324046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.324474 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:21.325313 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.325796 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.326208 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:21.456305 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:21.464823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-308b562e-16f3-4be2-b717-abd213334434 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.210047 Aug 31 10:58:21.465490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 315/598] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:21 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:21.491657 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:21.499937 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b8e85a21-3745-4a7f-afb0-89020a4a94cd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1681 microversion: 2.1 time: 0.187303 Aug 31 10:58:21.500518 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 284/599] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:21 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:21.638092 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:21.638787 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:21.649979 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.650481 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.650918 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:21.651608 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.652067 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.652509 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:21.786626 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:21.798191 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:21.799627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:21.800972 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9e395d74-4c58-4d6a-8e8f-90b781d34669 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.167188 Aug 31 10:58:21.801499 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 316/600] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:21 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:21.806877 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:21.807613 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:21.814775 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.817119 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.817758 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:21.818804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:21.819325 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:21.819791 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:22.063659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:22.072534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-808c595d-a92c-4a62-a32a-55264e4be394 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1752 microversion: 2.1 time: 0.271037 Aug 31 10:58:22.073102 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 285/601] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:21 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1752 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:22.320600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:22.321313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:22.328136 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:22.328607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:22.329034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:22.329724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:22.330218 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:22.330655 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:22.473580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:22.482149 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a8f36522-4678-4a1d-8c83-ccd8651c3cbb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.165350 Aug 31 10:58:22.482727 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 317/602] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:22 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:22.486780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:22.487361 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:22.494078 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:22.494563 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:22.494992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:22.495690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:22.496162 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:22.496577 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:22.499135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:22.521662 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:22.522452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:22.529462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:22.529982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:22.530415 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:22.531117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:22.531566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:22.531983 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:22.683532 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:22.691996 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f68c731b-552e-4fa9-b88a-450948049f02 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.208962 Aug 31 10:58:22.692891 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 286/603] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:22 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:22.714194 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:22.722049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a13d3136-fba5-4658-b256-bb27da0af465 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1681 microversion: 2.1 time: 0.204700 Aug 31 10:58:22.722660 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 318/604] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:22 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:22.824780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:22.825401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:22.832069 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:22.832565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:22.833043 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:22.833899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:22.834358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:22.834811 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:23.035631 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:23.049043 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:23.051198 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:23.052378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8ef23aeb-f3cb-442e-aeae-0a0b7fe18f3d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1808 microversion: 2.20 time: 0.231651 Aug 31 10:58:23.052903 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 287/605] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:22 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:23.099206 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:23.100162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:23.108282 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:23.109154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:23.109753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:23.110529 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:23.111133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:23.111548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:23.131935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:23.503020 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:23.503662 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:23.510764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:23.511251 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:23.511699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:23.513070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:23.513070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:23.513384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:23.557972 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:23.567585 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-fbd83d91-ab16-473e-b6cf-fc5bd49088d2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1752 microversion: 2.1 time: 0.473084 Aug 31 10:58:23.568311 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 319/606] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:23 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1752 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:23.713239 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:23.713893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:23.720715 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:23.721412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:23.722506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:23.723210 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:23.723671 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:23.724099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:24.230936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:24.239410 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-04091b6f-1a49-42ef-8cd8-37f650c74538 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.740273 Aug 31 10:58:24.240073 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 288/607] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:23 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:24.245683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:24.246329 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:24.252434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:24.252952 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:24.253377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:24.254126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:24.254605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:24.255203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:24.279373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:24.287905 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f73f226c-bb74-4f00-aa2c-9b13cbe29bf5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.578862 Aug 31 10:58:24.288646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 320/608] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:23 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:24.293506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:24.294130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:24.300548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:24.301166 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:24.301706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:24.302543 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:24.303073 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:24.303493 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:24.444534 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lazy-loading 'services' on Instance uuid 2336d69f-d13a-4040-bd92-5549daa38d82 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:58:24.504244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:24.514925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e3dd9273-013e-44dd-99da-e9f737c8a6b1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1681 microversion: 2.1 time: 0.272796 Aug 31 10:58:24.515933 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 289/609] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:24 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1681 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:24.521317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:24.522714 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:24.530815 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:24.531391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:24.531943 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:24.532831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:24.533381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:24.533917 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:24.572659 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1aa787c7-7316-419c-afc6-abf96fa6661a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82/os-volume_attachments/9c8d6d7e-c844-4a52-a223-5d1c3aad6f9b" status: 202 len: 0 microversion: 2.1 time: 0.282669 Aug 31 10:58:24.573302 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 321/610] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 10:58:24 2022] DELETE /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82/os-volume_attachments/9c8d6d7e-c844-4a52-a223-5d1c3aad6f9b => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:58:24.594999 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:24.596235 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:24.603268 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:24.603859 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:24.604372 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:24.605149 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:24.605669 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:24.606374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:24.833146 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:24.843180 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:24.844605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:24.845821 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4ad457ed-4682-40f9-bf47-0ac31c239260 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1795 microversion: 2.20 time: 0.328612 Aug 31 10:58:24.846398 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 290/611] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:58:24 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1795 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:58:24.922378 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:24.931369 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-78f0393f-abc3-4013-b347-02160de1c0e2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.340886 Aug 31 10:58:24.932058 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 322/612] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:24 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:25.103219 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-3d8371b0-5552-4c42-8139-d346fad02138 req-ad3caf10-5456-4ffd-ab00-4060a46b687c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e849d954-3d1f-494d-8394-f6ec1dba55c4", "name": "network-vif-deleted", "tag": "62d1ed4c-0d7e-428e-b0b3-580b313c4366"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:25.114321 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-3d8371b0-5552-4c42-8139-d346fad02138 req-ad3caf10-5456-4ffd-ab00-4060a46b687c service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.115047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-3d8371b0-5552-4c42-8139-d346fad02138 req-ad3caf10-5456-4ffd-ab00-4060a46b687c service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.115568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-3d8371b0-5552-4c42-8139-d346fad02138 req-ad3caf10-5456-4ffd-ab00-4060a46b687c service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.128742 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-3d8371b0-5552-4c42-8139-d346fad02138 req-ad3caf10-5456-4ffd-ab00-4060a46b687c service nova] Creating event network-vif-deleted:62d1ed4c-0d7e-428e-b0b3-580b313c4366 for instance e849d954-3d1f-494d-8394-f6ec1dba55c4 on hv-cinder-79578 Aug 31 10:58:25.134498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-3d8371b0-5552-4c42-8139-d346fad02138 req-ad3caf10-5456-4ffd-ab00-4060a46b687c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035184 Aug 31 10:58:25.135695 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 291/613] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:25.260992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:25.261610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:25.268144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.268640 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.269123 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.269868 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.270322 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.270740 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.310886 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:25.311895 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:25.325489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.329026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.329599 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.330587 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.331335 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.331969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.492920 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:25.509823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7e1c5fb9-a226-4a68-867c-2cf606531a73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.252806 Aug 31 10:58:25.510743 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 323/614] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:25 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:25.538010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:25.538733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:25.545829 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.551551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.552240 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.553528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.559993 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:25.561401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.562187 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.580639 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1fc4dc87-6dcf-40c8-b455-ad2acdffdaaf tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.274240 Aug 31 10:58:25.581232 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 292/615] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:25 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:25.613830 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.614329 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.614981 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.615992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lazy-loading 'fault' on Instance uuid e849d954-3d1f-494d-8394-f6ec1dba55c4 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:58:25.679083 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:25.693720 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d7e71c55-6098-4d5d-9abd-3df35276311b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1332 microversion: 2.1 time: 0.158239 Aug 31 10:58:25.694430 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 324/616] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:25 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1332 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:25.743176 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:25.743777 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:25.750076 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.750657 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.751079 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.752021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.752683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.753141 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.780449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:58:25.870227 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c3fa3b79-2e6f-46d7-b0cc-ab004daa7d72 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 204 len: 0 microversion: 2.1 time: 0.131849 Aug 31 10:58:25.870945 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 293/617] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:58:25 2022] DELETE /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:25.879325 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:25.879956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:25.886802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.888094 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.888551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.889289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.889811 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.890243 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.956925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:25.959145 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:25.967844 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.968727 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.969346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:25.970320 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:25.971046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:25.971623 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:26.101819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:26.113728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c36c8e75-54f6-4f4a-b5cb-426e66a1a1c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1513 microversion: 2.1 time: 0.238029 Aug 31 10:58:26.114879 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 325/618] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:25 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1513 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:26.178953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:26.190597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-338aa308-955f-4c00-b988-e40728851dd5 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.238329 Aug 31 10:58:26.191202 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 294/619] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:25 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:26.531524 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:26.532166 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:26.539140 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:26.539637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:26.540072 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:26.540925 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:26.541381 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:26.541805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:26.604072 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:26.604700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:26.611531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:26.612018 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:26.612449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:26.613151 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:26.613597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:26.614048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:26.716345 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:26.726105 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7f5c54b0-b56f-4823-b602-da2ad9814c4a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.198520 Aug 31 10:58:26.726670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 326/620] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:26 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:26.731705 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:26.732482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:26.739904 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:26.740395 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:26.740822 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:26.741580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:26.742046 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:26.742450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:26.768938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:26.774213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:26.774689 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:26.775333 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:26.775941 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lazy-loading 'fault' on Instance uuid e849d954-3d1f-494d-8394-f6ec1dba55c4 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:58:26.777374 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-97a3298e-54c1-466c-9348-ab62f20543ef tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1679 microversion: 2.1 time: 0.177357 Aug 31 10:58:26.778038 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 295/621] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:26 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:26.829727 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:26.838017 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-635985ae-1113-4f4c-b937-3338b36e8ed8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 200 len: 1332 microversion: 2.1 time: 0.109685 Aug 31 10:58:26.838590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 327/622] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:26 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:27.142954 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:27.143687 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:27.152329 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:27.153099 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:27.153689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:27.154781 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:27.155515 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:27.156184 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:27.212326 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:27.213044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:27.228971 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:27.229602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:27.230279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:27.231187 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:27.231646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:27.232072 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:27.324082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:27.338014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-666dc31a-97fd-4068-83a1-ce1565d99033 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1513 microversion: 2.1 time: 0.200760 Aug 31 10:58:27.338686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 296/623] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:27 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:27.394208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:27.402823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-72eb7e18-71de-4f22-8881-4381e13bbccf tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.194421 Aug 31 10:58:27.403404 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 328/624] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:27 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:27.747899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:27.748588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:27.756994 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:27.757490 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:27.757962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:27.758665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:27.759143 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:27.759563 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:27.799371 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:27.799964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:27.807290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:27.807825 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:27.808585 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:27.809564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:27.809754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:27.810532 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.003936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:28.012251 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4e227aa3-9fb6-4933-afe5-53d05d371573 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.268604 Aug 31 10:58:28.012837 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 297/625] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:27 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:28.025949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:28.025949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:28.025949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.025949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.026347 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.026507 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.026962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.027402 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.042031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 HTTP/1.1 Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 10:58:28.043682 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 10:58:28.045200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'e849d954-3d1f-494d-8394-f6ec1dba55c4'} Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:58:28.046301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 10:58:28.047702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:58:28.048982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:58:28.048982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e3845f75-dcf0-44cb-bb17-ef670dff1086 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 404 len: 111 microversion: 2.1 time: 0.031288 Aug 31 10:58:28.048982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 298/626] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:28 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:58:28.054202 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-25a8e80e-7efb-49d5-b0f2-0e9fc1fb57a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '.version_select at 0x7f37a8cb93a0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:28.074399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:28.076728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-25a8e80e-7efb-49d5-b0f2-0e9fc1fb57a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125531537" status: 202 len: 0 microversion: 2.1 time: 0.026397 Aug 31 10:58:28.077899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 299/627] 10.222.0.75 () {58 vars in 1221 bytes} [Wed Aug 31 10:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125531537 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 10:58:28.084352 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1c38cace-885a-4ce8-b347-f236fb391582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1656 microversion: 2.1 time: 0.289401 Aug 31 10:58:28.084939 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 329/628] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:27 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1656 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:28.106533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b5a20430-abdf-4859-879e-a21c1243a827 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:28.114273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b5a20430-abdf-4859-879e-a21c1243a827 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.114448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b5a20430-abdf-4859-879e-a21c1243a827 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.114764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b5a20430-abdf-4859-879e-a21c1243a827 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.178299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b5a20430-abdf-4859-879e-a21c1243a827 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Going to try to start instance {{(pid=120481) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 10:58:28.224926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b5a20430-abdf-4859-879e-a21c1243a827 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/action" status: 202 len: 0 microversion: 2.1 time: 0.122262 Aug 31 10:58:28.225674 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 300/629] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:58:28 2022] POST /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 10:58:28.234384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:28.235008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:28.241204 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.241695 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.242165 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.243068 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.243382 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.244075 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.359983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:28.360700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:28.367371 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.367875 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.368314 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.369085 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.369530 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.369990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.658422 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:28.666902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-dfda235f-9357-4b1c-8526-bcb9df7db230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1665 microversion: 2.1 time: 0.436481 Aug 31 10:58:28.667483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 330/630] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:28 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1665 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:28.685693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:28.686420 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:28.693217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.693709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.694172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.694887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.695339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.695761 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.722158 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:28.732476 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1ef63a06-c24d-449e-bf73-eba31a1768ba tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1513 microversion: 2.1 time: 0.376854 Aug 31 10:58:28.733728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 301/631] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:28 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1513 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:28.878346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-041daafa-99e2-4f1c-b0b0-0243e5f9fad2 req-528e9da9-b516-4ca3-9c0d-1de796f0c8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2336d69f-d13a-4040-bd92-5549daa38d82", "name": "network-vif-deleted", "tag": "626f67f7-9109-4add-8ced-00a8ba6b25da"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:28.891907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-041daafa-99e2-4f1c-b0b0-0243e5f9fad2 req-528e9da9-b516-4ca3-9c0d-1de796f0c8c1 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:28.892380 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-041daafa-99e2-4f1c-b0b0-0243e5f9fad2 req-528e9da9-b516-4ca3-9c0d-1de796f0c8c1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:28.892800 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-041daafa-99e2-4f1c-b0b0-0243e5f9fad2 req-528e9da9-b516-4ca3-9c0d-1de796f0c8c1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:28.905120 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-041daafa-99e2-4f1c-b0b0-0243e5f9fad2 req-528e9da9-b516-4ca3-9c0d-1de796f0c8c1 service nova] Creating event network-vif-deleted:626f67f7-9109-4add-8ced-00a8ba6b25da for instance 2336d69f-d13a-4040-bd92-5549daa38d82 on hv-cinder-79578 Aug 31 10:58:28.911135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-041daafa-99e2-4f1c-b0b0-0243e5f9fad2 req-528e9da9-b516-4ca3-9c0d-1de796f0c8c1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036818 Aug 31 10:58:28.911737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 302/632] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:58:29.020448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:29.030216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0d7368a5-24d9-446c-ab1c-d13e09ddfc06 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.348752 Aug 31 10:58:29.031016 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 331/633] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:28 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:29.034619 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:29.035347 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:29.053581 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.054103 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.054541 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.055252 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.055704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.056871 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.060131 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:29.317670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:29.318215 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:29.324422 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.324902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.325358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.326128 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.326599 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.327011 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.347220 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:29.355704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9ee47cc4-19c3-4957-bf0e-d832368227cc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.325996 Aug 31 10:58:29.358860 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 303/634] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:29 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:29.411305 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lazy-loading 'services' on Instance uuid 62cc77f5-17ed-46dc-bc9f-a927415fc639 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:58:29.494164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5b96dd9b-0ddb-4b66-a0ac-19459b26dcdb tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments/5f7962eb-6d8a-4106-8ec0-17728c136436" status: 202 len: 0 microversion: 2.1 time: 0.180358 Aug 31 10:58:29.498169 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 332/635] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 10:58:29 2022] DELETE /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments/5f7962eb-6d8a-4106-8ec0-17728c136436 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:58:29.503505 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-75206938-7e6a-4653-8381-b9dd61d74821 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:29.505673 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-75206938-7e6a-4653-8381-b9dd61d74821 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:29.512036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-75206938-7e6a-4653-8381-b9dd61d74821 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.512524 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-75206938-7e6a-4653-8381-b9dd61d74821 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.512962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-75206938-7e6a-4653-8381-b9dd61d74821 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.513652 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-75206938-7e6a-4653-8381-b9dd61d74821 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.514128 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-75206938-7e6a-4653-8381-b9dd61d74821 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.514603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-75206938-7e6a-4653-8381-b9dd61d74821 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.544387 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-75206938-7e6a-4653-8381-b9dd61d74821 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Aug 31 10:58:29.544930 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 304/636] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 10:58:29 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:29.689250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:29.689993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:29.696492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.697221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.697703 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.698467 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.698917 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.699333 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.755119 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:29.755755 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:29.762057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.762579 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.763015 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.763715 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.764168 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.764590 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.797338 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:29.797955 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:29.798393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:29.798838 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lazy-loading 'fault' on Instance uuid 2336d69f-d13a-4040-bd92-5549daa38d82 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:58:29.857696 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:29.861250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:29.865789 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-15f36626-96b8-4074-ae88-adb3c6825aa0 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 200 len: 1308 microversion: 2.1 time: 0.114630 Aug 31 10:58:29.866370 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 305/637] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:29 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:29.869026 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-80b8e4fd-49d1-44d4-b775-af3bf5e269a5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1665 microversion: 2.1 time: 0.184112 Aug 31 10:58:29.869582 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 333/638] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:29 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1665 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:30.053087 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:30.055354 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:30.063308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.063851 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.064286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.065007 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.065467 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.065919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.377020 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:30.377584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:30.384118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.384686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.385124 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.385852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.386315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.386757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.391857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:30.607661 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:30.619149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8b035a92-9b08-49b3-86f3-6d4a1f0c0c31 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.570629 Aug 31 10:58:30.619740 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 306/639] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:30 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:30.636425 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:30.637949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-73e36ec6-02df-4278-a8cd-5b8579dd1ad6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:30.640566 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-73e36ec6-02df-4278-a8cd-5b8579dd1ad6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:30.644790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9a6b7aa2-7479-4fe1-9948-e45652a50e7f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.271808 Aug 31 10:58:30.645364 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 334/640] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:30 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:30.646926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73e36ec6-02df-4278-a8cd-5b8579dd1ad6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.647413 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73e36ec6-02df-4278-a8cd-5b8579dd1ad6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.647833 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73e36ec6-02df-4278-a8cd-5b8579dd1ad6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.648540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73e36ec6-02df-4278-a8cd-5b8579dd1ad6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.648981 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73e36ec6-02df-4278-a8cd-5b8579dd1ad6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.649421 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73e36ec6-02df-4278-a8cd-5b8579dd1ad6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.680462 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-73e36ec6-02df-4278-a8cd-5b8579dd1ad6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Aug 31 10:58:30.681031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 307/641] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 10:58:30 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:30.889905 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:30.891077 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: 2336d69f-d13a-4040-bd92-5549daa38d82] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:30.891551 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:30.892176 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:30.898748 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.898916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.899237 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.899457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.899691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.900011 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.900421 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.900831 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:30.900927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.901279 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.901433 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:30.901947 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:30.916825 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] HTTP exception thrown: Instance 2336d69f-d13a-4040-bd92-5549daa38d82 could not be found. Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Request method failure captured: Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 HTTP/1.1 Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz53htNOL6_T_U2T-UuByNgWpsfXX3IZuSQFHUvFippFJaf_KxjkSsPmhAi2YsXapzqX-i1uqLX7dc5PLZth-tBtACAsEA1Agf8XI0hl5Bn7hxYdzJMeLg6z1KvmCI561K-OF-3yAguXaGNc8mZ9DpGNdqEYZFLH7RHm5ii4y3k4Uj4 Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 4ff7c6e80bed43ecbcf17e4fa1bad450 Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-VolumesSnapshotTestJSON-506169213 Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:58:30.918573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_4ff7c6e80bed43ecbcf17e4fa1bad450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/4ff7c6e80bed43ecbcf17e4fa1bad450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/4ff7c6e80bed43ecbcf17e4fa1bad450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/4ff7c6e80bed43ecbcf17e4fa1bad450"}]}] Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-VolumesSnapshotTestJSON-506169213 Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 4ff7c6e80bed43ecbcf17e4fa1bad450 Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-506169213 Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-VolumesSnapshotTestJSON-506169213-project Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 9cf2f9dbdcfe4cce91fd4c03cd8e8bba Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-VolumesSnapshotTestJSON-506169213-project Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 2336d69f-d13a-4040-bd92-5549daa38d82 could not be found. Aug 31 10:58:30.920154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '2336d69f-d13a-4040-bd92-5549daa38d82'} Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2336d69f-d13a-4040-bd92-5549daa38d82 could not be found. Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:58:30.921029 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2336d69f-d13a-4040-bd92-5549daa38d82 could not be found. Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2336d69f-d13a-4040-bd92-5549daa38d82 could not be found. Aug 31 10:58:30.926755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:30.928159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Returning 404 to user: Instance 2336d69f-d13a-4040-bd92-5549daa38d82 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:58:30.928159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-71a3ddce-6ee6-4bb5-b2a3-3d36f8f65f1a tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82" status: 404 len: 111 microversion: 2.1 time: 0.036362 Aug 31 10:58:30.928159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 335/642] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:30 2022] GET /compute/v2.1/servers/2336d69f-d13a-4040-bd92-5549daa38d82 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:58:31.044958 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:31.053643 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1911ee09-f6a3-43fc-abef-a0cc313fbefd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1665 microversion: 2.1 time: 0.167505 Aug 31 10:58:31.054327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 308/643] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:30 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:31.645089 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:31.646228 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:31.654807 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:31.655279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:31.655725 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:31.656419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:31.656873 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:31.657297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:31.665976 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:31.666585 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:31.673302 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:31.673818 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:31.674240 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:31.674928 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:31.675376 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:31.675789 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:31.871700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:31.876614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:31.880186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-af602951-80d5-4877-9c9d-fa567d57cc83 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.218096 Aug 31 10:58:31.880793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 309/644] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:31 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:31.885439 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8e8ed678-4fc1-4919-9031-0430d8c5210a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:31.885720 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4a98ee9b-a146-4da9-beca-c506463b5de1 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.247523 Aug 31 10:58:31.893203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 336/645] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:31 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:31.893358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8e8ed678-4fc1-4919-9031-0430d8c5210a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:31.894104 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e8ed678-4fc1-4919-9031-0430d8c5210a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:31.894589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e8ed678-4fc1-4919-9031-0430d8c5210a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:31.895015 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e8ed678-4fc1-4919-9031-0430d8c5210a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:31.895703 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e8ed678-4fc1-4919-9031-0430d8c5210a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:31.896149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e8ed678-4fc1-4919-9031-0430d8c5210a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:31.896563 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8e8ed678-4fc1-4919-9031-0430d8c5210a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:31.927413 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8e8ed678-4fc1-4919-9031-0430d8c5210a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045456 Aug 31 10:58:31.928178 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 310/646] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 10:58:31 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 10:58:31.989577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:31.990181 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:31.997402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:31.998007 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:31.998662 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:31.999288 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:31.999805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:32.000215 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:32.027583 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:58:32.077407 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:32.078042 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:32.096074 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:32.097497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:32.098023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:32.098749 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:32.099196 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:32.099615 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:32.117272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-76631ebf-1729-456c-994c-cc6eda5b0e07 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 204 len: 0 microversion: 2.1 time: 0.131368 Aug 31 10:58:32.117890 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 337/647] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:58:31 2022] DELETE /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:58:32.126731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:32.127510 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:32.133593 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:32.134140 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:32.134559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:32.135264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:32.135715 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:32.136255 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:32.283712 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:32.291799 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b9997489-b89e-4aed-93bc-c33e4eac3cb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1669 microversion: 2.1 time: 0.218604 Aug 31 10:58:32.292454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 311/648] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:32 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1669 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:32.310371 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:32.318913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-912d3db5-84bc-4ed1-9554-85dcbb303b6c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1683 microversion: 2.1 time: 0.196426 Aug 31 10:58:32.319491 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 338/649] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:32 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1683 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:32.900851 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:32.901559 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:32.906306 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:32.906927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:32.908864 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:32.909356 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:32.909811 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:32.910538 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:32.910992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:32.911410 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:32.914128 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:32.914612 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:32.915057 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:32.915749 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:32.916197 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:32.916599 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:33.117660 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:33.126010 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-cf924baf-ea45-4ea3-8197-77e49999b40d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.229082 Aug 31 10:58:33.126587 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 312/650] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:32 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:33.126978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:33.136351 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-45363fc2-c3d6-4097-995d-4f26fadaa9a9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.233919 Aug 31 10:58:33.136935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 339/651] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:32 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:33.349754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:33.350715 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:33.358865 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:33.359355 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:33.359787 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:33.360475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:33.360926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:33.361348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:33.508315 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:33.516235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-761ec411-d6b2-4a78-b1fc-be0287efbac6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1683 microversion: 2.1 time: 0.172792 Aug 31 10:58:33.516808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 313/652] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:33 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:34.150691 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:34.151293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:34.158252 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:34.158926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:34.159079 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:34.159553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:34.160044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:34.160836 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:34.161342 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:34.161819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:34.166678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:34.167164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:34.167990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:34.168707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:34.169163 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:34.169581 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:34.383360 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:34.390587 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:34.403498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7ad2ee8a-e6c9-4f1a-8635-2106367f60aa tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.249501 Aug 31 10:58:34.403687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e65aa591-a3a5-4fa2-808c-e5f7e886fd29 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.259340 Aug 31 10:58:34.403970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 314/653] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:34 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:34.412147 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 340/654] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:34 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:34.538576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:34.539326 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:34.546607 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:34.547178 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:34.547685 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:34.548500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:34.549033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:34.549531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:34.682424 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:34.690816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-991d06c1-a395-4c5b-934a-659e201799ae tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1683 microversion: 2.1 time: 0.156961 Aug 31 10:58:34.691406 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 315/655] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:34 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:35.426452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:35.427481 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:35.430999 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:35.436691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:35.437310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:35.437435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:35.437616 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:35.438046 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:35.438734 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:35.439188 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:35.439609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:35.443515 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:35.445659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:35.445659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:35.445659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:35.446596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:35.446596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:35.660078 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:35.664966 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:35.668160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a85d3696-27ee-444a-b52b-de706d9e8bb4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.239038 Aug 31 10:58:35.668857 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 316/656] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:35 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:35.678466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-85496242-61c7-4269-9c97-d196074572b8 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.257679 Aug 31 10:58:35.679175 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 341/657] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:35 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:35.712613 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:35.713228 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:35.719669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:35.720154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:35.720585 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:35.721313 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:35.721786 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:35.722223 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:35.886237 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:35.899093 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-150d2005-c159-4621-aa45-d5d15419bfd9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1683 microversion: 2.1 time: 0.190114 Aug 31 10:58:35.899669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 317/658] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:35 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:36.590748 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-2c111fb0-1614-4629-9743-3165d35f98fa req-ef7d27b1-d795-409f-ac19-4e86c4590933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91b10cf-8d7d-4896-be69-bc4c8089a324", "name": "network-vif-plugged", "status": "completed", "tag": "5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:36.606940 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-2c111fb0-1614-4629-9743-3165d35f98fa req-ef7d27b1-d795-409f-ac19-4e86c4590933 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:36.607664 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-2c111fb0-1614-4629-9743-3165d35f98fa req-ef7d27b1-d795-409f-ac19-4e86c4590933 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:36.608322 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-2c111fb0-1614-4629-9743-3165d35f98fa req-ef7d27b1-d795-409f-ac19-4e86c4590933 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:36.621196 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-2c111fb0-1614-4629-9743-3165d35f98fa req-ef7d27b1-d795-409f-ac19-4e86c4590933 service nova] Creating event network-vif-plugged:5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6 for instance c91b10cf-8d7d-4896-be69-bc4c8089a324 on hv-cinder-79578 Aug 31 10:58:36.628715 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-2c111fb0-1614-4629-9743-3165d35f98fa req-ef7d27b1-d795-409f-ac19-4e86c4590933 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043432 Aug 31 10:58:36.629665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 342/659] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:36.692147 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:36.692871 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:36.701516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:36.702251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:36.709073 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:36.709908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:36.710495 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:36.711338 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:36.711921 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:36.712470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:36.716932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:36.717805 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:36.718606 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:36.719373 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:36.719859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:36.722173 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:37.114018 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:37.122444 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e67a64af-c477-4419-bfa4-7220bd4db9ee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.437044 Aug 31 10:58:37.123045 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 318/660] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:36 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:37.123309 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:37.128034 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:37.128862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:37.135185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4d457523-9321-4bab-8ed3-676d9b71dbfe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.438242 Aug 31 10:58:37.145824 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 343/661] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:36 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:37.145997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:37.145997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:37.145997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:37.145997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:37.146389 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:37.146389 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:37.160316 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:37.352693 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:37.362169 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7226546f-d44b-4b81-ad25-1a7e9557a3d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1683 microversion: 2.1 time: 0.237831 Aug 31 10:58:37.362708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 319/662] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:37 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:37.727431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-b11a12f2-2fe9-469a-8d43-686a6d300f7e req-a18ee7f6-f8e7-467a-a9aa-792db922acc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cc77f5-17ed-46dc-bc9f-a927415fc639", "name": "network-vif-deleted", "tag": "ec5b6938-c6c5-49ac-a90a-5196ce5d9611"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:37.737544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-b11a12f2-2fe9-469a-8d43-686a6d300f7e req-a18ee7f6-f8e7-467a-a9aa-792db922acc4 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:37.738155 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-b11a12f2-2fe9-469a-8d43-686a6d300f7e req-a18ee7f6-f8e7-467a-a9aa-792db922acc4 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:37.738665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-b11a12f2-2fe9-469a-8d43-686a6d300f7e req-a18ee7f6-f8e7-467a-a9aa-792db922acc4 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:37.750707 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-b11a12f2-2fe9-469a-8d43-686a6d300f7e req-a18ee7f6-f8e7-467a-a9aa-792db922acc4 service nova] Creating event network-vif-deleted:ec5b6938-c6c5-49ac-a90a-5196ce5d9611 for instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 on hv-cinder-79578 Aug 31 10:58:37.756528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-b11a12f2-2fe9-469a-8d43-686a6d300f7e req-a18ee7f6-f8e7-467a-a9aa-792db922acc4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Aug 31 10:58:37.757387 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 344/663] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:38.144207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:38.144811 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:38.152719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:38.153192 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:38.153606 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:38.154366 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:38.154817 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:38.155236 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:38.157931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:38.158989 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:38.165817 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:38.166462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:38.166961 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:38.167715 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:38.168215 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:38.169074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:38.376501 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:38.386069 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b2824699-7e8e-4888-83de-143758606b7e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.246041 Aug 31 10:58:38.386613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:38.388013 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 320/664] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:38 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:38.393903 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:38.394508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:38.395607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-39e96a14-975d-44b4-b3ab-b19b04134bc9 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.242525 Aug 31 10:58:38.397184 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 345/665] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:38 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:38.400403 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:38.401074 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:38.401501 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:38.402567 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:38.403024 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:38.403442 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:38.467447 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:38.475779 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-18f7c358-9c9f-4b8e-965c-a7cefd7872f0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1615 microversion: 2.1 time: 0.086073 Aug 31 10:58:38.476352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 321/666] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:38 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:39.412139 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:39.414317 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:39.419480 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:39.420097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:39.422818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:39.423310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:39.423750 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:39.424471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:39.424935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:39.425359 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:39.427207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:39.427705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:39.428137 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:39.428823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:39.429264 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:39.429698 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:39.627641 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:39.635809 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-01171267-b7fe-41ca-a9fb-e8bd2ab5e403 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.230175 Aug 31 10:58:39.636818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 346/667] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:39 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:39.643512 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:39.644145 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:39.645545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:39.652449 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:39.652930 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:39.653365 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:39.654058 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:39.654507 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:39.654922 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:39.655937 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8001e393-5ca2-4a60-9833-a3d69c5b9e97 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.241991 Aug 31 10:58:39.656531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 322/668] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:39 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:39.727819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:39.735736 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3b4b3805-dba9-472b-9ff4-bf52146c14b5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1615 microversion: 2.1 time: 0.097615 Aug 31 10:58:39.736315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 347/669] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:39 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:40.658831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:40.659418 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:40.666623 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:40.667128 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:40.667603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:40.668365 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:40.668804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:40.669217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:40.676366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:40.677050 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:40.684269 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:40.684753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:40.685182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:40.685916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:40.686369 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:40.686792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:40.873062 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:40.882036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0e03dda1-6a6b-4070-9661-10232cdab9cb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1260 microversion: 2.1 time: 0.227388 Aug 31 10:58:40.883912 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 323/670] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:40 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:40.888928 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:40.889533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:40.895935 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:40.896454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:40.897061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:40.897752 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:40.898337 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:40.898826 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:40.900118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:40.910610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f6521dff-4000-40a8-960e-a32542c88521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.238000 Aug 31 10:58:40.912249 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 348/671] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:40 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:40.940907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:40.941395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:40.941885 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:40.942297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lazy-loading 'fault' on Instance uuid 62cc77f5-17ed-46dc-bc9f-a927415fc639 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:58:40.984961 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:40.992299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-767299186", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "networks": [{"uuid": "fe0f8a55-6b5e-4ea7-b30a-51663df0572c"}]}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:40.993323 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fea0da65-373f-4c80-b553-a27cf572a72f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1332 microversion: 2.1 time: 0.108273 Aug 31 10:58:40.993921 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 324/672] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:40 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:41.046747 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] validate_networks() for [('fe0f8a55-6b5e-4ea7-b30a-51663df0572c', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:58:41.403498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:58:41.404099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:58:41.404749 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:58:41.405381 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:58:41.405785 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:58:41.419127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:41.419613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:41.420049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:41.420773 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:41.421222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:41.421638 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:41.439020 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Getting quotas for project 4ff7c6e80bed43ecbcf17e4fa1bad450. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:58:41.442944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Getting quotas for user 9cf2f9dbdcfe4cce91fd4c03cd8e8bba and project 4ff7c6e80bed43ecbcf17e4fa1bad450. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:58:41.454398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:58:41.456833 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:58:41.508148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1bf4a6ce-c156-496b-a44f-fa59f6f044f5 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519683 Aug 31 10:58:41.509160 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 349/673] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:58:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 10:58:41.520126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b50aafd4-5991-4b01-be29-29d68802fc36 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:41.520807 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b50aafd4-5991-4b01-be29-29d68802fc36 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:41.528571 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:41.586905 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b50aafd4-5991-4b01-be29-29d68802fc36 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:41.594728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b50aafd4-5991-4b01-be29-29d68802fc36 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1218 microversion: 2.1 time: 0.078530 Aug 31 10:58:41.595430 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 325/674] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:41 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:41.904459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:41.905215 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:41.912038 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:41.912709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:41.913294 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:41.914169 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:41.914779 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:41.915371 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:41.933724 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:41.934363 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:41.941071 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:41.941742 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:41.942371 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:41.943063 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:41.943508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:41.943922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:42.120982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:42.131547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9dcf008f-fe44-43dd-948b-4e90cb156a3f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1444 microversion: 2.1 time: 0.231257 Aug 31 10:58:42.132150 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 350/675] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:41 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1444 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:42.151182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:42.152174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:42.158020 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:42.159662 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:42.160335 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:42.160767 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:42.161464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:42.162487 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:42.163267 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:42.172616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-73d74236-7cb7-4a82-b2aa-f675a77797fe tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.243584 Aug 31 10:58:42.183952 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 326/676] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:41 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:42.188918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:42.189600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:42.196669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:42.201179 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:42.201819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:42.202379 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:42.202880 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:42.203110 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:42.203356 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:42.204276 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lazy-loading 'fault' on Instance uuid 62cc77f5-17ed-46dc-bc9f-a927415fc639 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:58:42.204614 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:42.205048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:42.208117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:42.253717 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:42.269858 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-187ecec8-920a-4911-847d-4d316b4017e6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 200 len: 1332 microversion: 2.1 time: 0.123199 Aug 31 10:58:42.270449 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 351/677] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:42 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:42.375799 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:42.384634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-cc00938b-c3db-43c5-9135-5d535b8c4af6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1444 microversion: 2.1 time: 0.199607 Aug 31 10:58:42.385225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 327/678] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:42 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1444 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:42.614903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:42.615544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:42.621699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:42.622246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:42.622671 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:42.623497 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:42.623983 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:42.624380 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:42.696874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:42.704775 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b795d807-8daf-4796-aaf1-edd866445bdf tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1270 microversion: 2.1 time: 0.093661 Aug 31 10:58:42.718188 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 352/679] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:42 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:43.200777 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:43.201401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:43.209238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:43.210319 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:43.210749 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:43.211621 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:43.212078 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:43.212497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:43.293534 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:43.295417 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:43.302968 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:43.303549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:43.304037 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:43.304829 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:43.305338 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:43.306398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:43.321900 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 HTTP/1.1 Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:58:43.323899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 10:58:43.325570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '62cc77f5-17ed-46dc-bc9f-a927415fc639'} Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:58:43.326706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 10:58:43.328588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:58:43.330845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:58:43.330845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e43b3c10-9e8e-4897-80f2-f0093a4bcdac tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 404 len: 111 microversion: 2.1 time: 0.038822 Aug 31 10:58:43.330845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 353/680] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:43 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:58:43.336698 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9d9c0da1-58a1-4b7b-82f9-3371bc169190 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '.version_select at 0x7f37a8b77ee0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:43.359613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9d9c0da1-58a1-4b7b-82f9-3371bc169190 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273694664" status: 202 len: 0 microversion: 2.1 time: 0.026756 Aug 31 10:58:43.360291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 354/681] 10.222.0.75 () {58 vars in 1221 bytes} [Wed Aug 31 10:58:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1273694664 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:58:43.694150 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:43.702674 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-59814402-a73e-4d96-a7e7-57f97270ca76 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.506954 Aug 31 10:58:43.703238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 328/682] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:43 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:43.726737 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:43.727273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:43.734379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:43.734877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:43.735778 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:43.736537 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:43.736972 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:43.737449 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:43.830118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:43.837481 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-544c43bc-20a0-4e8e-895d-d2c4588a9a94 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1276 microversion: 2.1 time: 0.115563 Aug 31 10:58:43.840091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 355/683] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:43 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:44.027398 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-43890817-b031-45fc-a6b3-69e0fb0d91e5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: .version_select at 0x7f37a8c55af0>, body: {"keypair": {"name": "tempest-keypair-52457514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGvLpI1sWnehvtT8VjCFded5dDswHRp+8E2B4qi88eu6C3FS1ARUdBZQFBqpXd/NBJwQQkCCP9f0ARpBtvw6JutrLVhD0FWTFJAVw1uHOI2oqMGsbkIIfnJe4OCioqU6Q=="}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:44.043087 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-43890817-b031-45fc-a6b3-69e0fb0d91e5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:58:44.046926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-43890817-b031-45fc-a6b3-69e0fb0d91e5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for user 73f1b9e32ad3493284c5df45afd042fa and project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:58:44.071985 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-43890817-b031-45fc-a6b3-69e0fb0d91e5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.048759 Aug 31 10:58:44.072863 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 329/684] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 10:58:44 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:44.724642 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:44.726108 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:44.735039 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:44.736014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:44.736674 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:44.737396 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:44.737886 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:44.738324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:44.859492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:44.860262 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:44.867211 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:44.869191 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:44.869700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:44.870783 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:44.871153 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:44.871657 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:45.160799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:45.183047 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d543ef76-89bc-4ed3-aceb-088cc80cd67a tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.462415 Aug 31 10:58:45.198101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 356/685] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:44 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:45.268046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:45.286690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3eff8262-683d-403b-a650-48f21f14d09c tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1318 microversion: 2.1 time: 0.431159 Aug 31 10:58:45.287588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 330/686] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:44 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:45.384422 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-07786c96-7bdc-4d6e-bed3-9c2bebe04d69 req-243e777a-fbe3-4c8e-a74a-7db9bc89aa83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91b10cf-8d7d-4896-be69-bc4c8089a324", "tag": "5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:45.395205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-07786c96-7bdc-4d6e-bed3-9c2bebe04d69 req-243e777a-fbe3-4c8e-a74a-7db9bc89aa83 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:45.396203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-07786c96-7bdc-4d6e-bed3-9c2bebe04d69 req-243e777a-fbe3-4c8e-a74a-7db9bc89aa83 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:45.396697 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-07786c96-7bdc-4d6e-bed3-9c2bebe04d69 req-243e777a-fbe3-4c8e-a74a-7db9bc89aa83 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:45.410312 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-07786c96-7bdc-4d6e-bed3-9c2bebe04d69 req-243e777a-fbe3-4c8e-a74a-7db9bc89aa83 service nova] Creating event network-changed:5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6 for instance c91b10cf-8d7d-4896-be69-bc4c8089a324 on hv-cinder-79578 Aug 31 10:58:45.416389 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-07786c96-7bdc-4d6e-bed3-9c2bebe04d69 req-243e777a-fbe3-4c8e-a74a-7db9bc89aa83 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036113 Aug 31 10:58:45.417915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 357/687] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:45.483700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1089354404", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea0de259-9ec9-40ad-9450-e7dd0067411a"}], "security_groups": [{"name": "tempest-securitygroup--1388479652"}], "key_name": "tempest-keypair-52457514", "user_data": "}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:45.720371 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.network.neutron [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] validate_networks() for [('ea0de259-9ec9-40ad-9450-e7dd0067411a', None, None, None, None, None)] {{(pid=120481) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:58:45.841102 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fab467a1-6df6-4d9b-a7fa-1bcdd9b44026 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a08717e2-b9f6-48d4-be09-5454f716fbe2"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:45.843779 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-fab467a1-6df6-4d9b-a7fa-1bcdd9b44026 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:45.852231 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fab467a1-6df6-4d9b-a7fa-1bcdd9b44026 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:45.852730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fab467a1-6df6-4d9b-a7fa-1bcdd9b44026 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:45.853162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fab467a1-6df6-4d9b-a7fa-1bcdd9b44026 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:45.853901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fab467a1-6df6-4d9b-a7fa-1bcdd9b44026 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:45.854337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fab467a1-6df6-4d9b-a7fa-1bcdd9b44026 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:45.854973 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fab467a1-6df6-4d9b-a7fa-1bcdd9b44026 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:46.139036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-fab467a1-6df6-4d9b-a7fa-1bcdd9b44026 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305623 Aug 31 10:58:46.140403 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 358/688] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 10:58:45 2022] POST /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:46.212457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:46.217907 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:46.246754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:46.247278 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:46.247709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:46.248428 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:46.248878 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:46.249287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:46.712250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:46.721103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-23f04652-65da-41ac-8420-1c1da9d29734 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1757 microversion: 2.1 time: 0.518847 Aug 31 10:58:46.721552 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 359/689] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:46 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1757 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:46.726136 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:46.726873 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:46.732776 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:46.733257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:46.733694 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:46.734925 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:46.735375 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:46.741617 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:47.009290 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Flavor limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:58:47.009835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Image limits 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:58:47.010215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Flavor pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:58:47.010621 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Image pref 0:0:0 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:58:47.011061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.virt.hardware [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120481) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:58:47.020561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:47.021018 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:47.021453 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:47.022208 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:47.022674 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:47.023097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:47.023422 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:47.031578 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ee7cc702-e8da-4591-960a-575c992cf1c8 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1318 microversion: 2.1 time: 0.309013 Aug 31 10:58:47.032161 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 360/690] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:46 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:47.042396 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:58:47.047440 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for user 73f1b9e32ad3493284c5df45afd042fa and project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:58:47.062248 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Going to run 1 instances... {{(pid=120481) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:58:47.064821 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120481) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:58:47.115048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-03f43519-43aa-4273-8e4e-a38539705ff9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.635625 Aug 31 10:58:47.116489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 331/691] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:58:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 10:58:47.128875 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7382649a-5936-4483-8e64-2b0205f5cb36 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:47.129482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7382649a-5936-4483-8e64-2b0205f5cb36 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:47.184282 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7382649a-5936-4483-8e64-2b0205f5cb36 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:47.192019 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7382649a-5936-4483-8e64-2b0205f5cb36 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1240 microversion: 2.1 time: 0.067257 Aug 31 10:58:47.192569 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 361/692] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:47 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:47.434443 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-b8f83fa3-cb5a-4d20-8fcf-208bf611f25d req-042b6c63-f372-46b6-9a19-8b102ff11486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf3d3918-60f7-408a-86a7-efa330e561d0", "tag": "cb6e475d-a97e-4d4b-a11f-d4ae5e98f784"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:47.459625 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-b8f83fa3-cb5a-4d20-8fcf-208bf611f25d req-042b6c63-f372-46b6-9a19-8b102ff11486 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:47.460125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-b8f83fa3-cb5a-4d20-8fcf-208bf611f25d req-042b6c63-f372-46b6-9a19-8b102ff11486 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:47.467606 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-b8f83fa3-cb5a-4d20-8fcf-208bf611f25d req-042b6c63-f372-46b6-9a19-8b102ff11486 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:47.479778 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-b8f83fa3-cb5a-4d20-8fcf-208bf611f25d req-042b6c63-f372-46b6-9a19-8b102ff11486 service nova] Creating event network-changed:cb6e475d-a97e-4d4b-a11f-d4ae5e98f784 for instance bf3d3918-60f7-408a-86a7-efa330e561d0 on hv-cinder-79578 Aug 31 10:58:47.485428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-b8f83fa3-cb5a-4d20-8fcf-208bf611f25d req-042b6c63-f372-46b6-9a19-8b102ff11486 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055970 Aug 31 10:58:47.486194 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 332/693] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:47.743503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:47.744481 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:47.751280 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:47.751824 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:47.752397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:47.753125 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:47.753572 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:47.754206 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:47.945579 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:47.956521 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f8764196-12cb-4da6-aa83-9d373e662540 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1760 microversion: 2.1 time: 0.217242 Aug 31 10:58:47.957120 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 362/694] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:47 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1760 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:48.054003 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:48.054826 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:48.061763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:48.062460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:48.063180 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:48.064153 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:48.064784 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:48.065366 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:48.199446 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:48.208703 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6823feb3-bbd6-47df-8ec7-a9d7857929ac tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1318 microversion: 2.1 time: 0.159757 Aug 31 10:58:48.209292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 333/695] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:48 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:48.213479 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:48.214092 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:48.220663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:48.221398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:48.221996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:48.222891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:48.223321 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:48.223930 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:48.290293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:48.298181 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2748bb87-a717-415b-af03-5ea0176c3de3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1292 microversion: 2.1 time: 0.089388 Aug 31 10:58:48.298742 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 363/696] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:48 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:49.232614 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:49.233266 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:49.239822 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:49.240309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:49.240747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:49.241443 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:49.241922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:49.242321 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:49.319683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:49.320629 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:49.328049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:49.328540 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:49.328991 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:49.329682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:49.330162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:49.330574 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:49.386482 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:49.394445 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fc8b20da-5ece-4421-8f63-bd9d58305251 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1318 microversion: 2.1 time: 0.165729 Aug 31 10:58:49.394979 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 334/697] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:49 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:49.403676 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:49.411346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9861ab7a-75cd-4f9a-a49a-97707025e249 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1292 microversion: 2.1 time: 0.095726 Aug 31 10:58:49.412015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 364/698] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:49 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:50.415664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:50.416315 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:50.423165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:50.423672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:50.424092 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:50.424786 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:50.425414 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:50.426040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:50.432622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:50.433257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:50.445092 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:50.445420 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:50.445878 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:50.453279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:50.453743 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:50.454360 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:50.723948 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:50.733489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5b3f5ee3-7e02-4395-9b71-ad2c1fa5ea95 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1318 microversion: 2.1 time: 0.321805 Aug 31 10:58:50.734276 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 335/699] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:50 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:50.765211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:50.774513 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4f2b31f2-eba1-4331-a130-ac3e66f6147c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1366 microversion: 2.1 time: 0.346033 Aug 31 10:58:50.775296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 365/700] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:50 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:58:51.271698 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-0dc5bbb7-1c95-4296-b85f-425210f17458 req-709b872c-ebeb-45dc-b972-65711930b792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb34b296-2951-4f41-be97-703d0d35dfe4", "tag": "df151cfd-29a8-42f3-9cd6-315c1ca177f3"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:51.283188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-0dc5bbb7-1c95-4296-b85f-425210f17458 req-709b872c-ebeb-45dc-b972-65711930b792 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:51.283672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-0dc5bbb7-1c95-4296-b85f-425210f17458 req-709b872c-ebeb-45dc-b972-65711930b792 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:51.284099 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-0dc5bbb7-1c95-4296-b85f-425210f17458 req-709b872c-ebeb-45dc-b972-65711930b792 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:51.296009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-0dc5bbb7-1c95-4296-b85f-425210f17458 req-709b872c-ebeb-45dc-b972-65711930b792 service nova] Creating event network-changed:df151cfd-29a8-42f3-9cd6-315c1ca177f3 for instance cb34b296-2951-4f41-be97-703d0d35dfe4 on hv-cinder-79578 Aug 31 10:58:51.300874 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-0dc5bbb7-1c95-4296-b85f-425210f17458 req-709b872c-ebeb-45dc-b972-65711930b792 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033268 Aug 31 10:58:51.301466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 336/701] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:58:51.756318 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:51.756973 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:51.759391 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:51.765735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:51.766238 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:51.766673 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:51.767411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:51.767858 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:51.768275 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:51.797595 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:51.798522 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:51.805925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:51.806407 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:51.806839 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:51.807549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:51.807997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:51.808458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:52.127188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:52.129573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:52.135854 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ad57a861-6869-48f9-a394-b8d18a79677c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1366 microversion: 2.1 time: 0.343663 Aug 31 10:58:52.136434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 337/702] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:51 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:52.138057 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-60ea4cf8-3e03-4f5a-98e8-36353b65aea7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1318 microversion: 2.1 time: 0.385683 Aug 31 10:58:52.139172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 366/703] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:51 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:52.142411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-2f819103-e725-47a5-b5cc-003098106737 req-8c21dcbf-475f-4be5-b005-7b124f9a3b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3d3918-60f7-408a-86a7-efa330e561d0", "name": "network-vif-plugged", "status": "completed", "tag": "cb6e475d-a97e-4d4b-a11f-d4ae5e98f784"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:52.152315 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-2f819103-e725-47a5-b5cc-003098106737 req-8c21dcbf-475f-4be5-b005-7b124f9a3b88 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:52.152672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-2f819103-e725-47a5-b5cc-003098106737 req-8c21dcbf-475f-4be5-b005-7b124f9a3b88 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:52.153110 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-2f819103-e725-47a5-b5cc-003098106737 req-8c21dcbf-475f-4be5-b005-7b124f9a3b88 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:52.164404 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-2f819103-e725-47a5-b5cc-003098106737 req-8c21dcbf-475f-4be5-b005-7b124f9a3b88 service nova] Creating event network-vif-plugged:cb6e475d-a97e-4d4b-a11f-d4ae5e98f784 for instance bf3d3918-60f7-408a-86a7-efa330e561d0 on hv-cinder-79578 Aug 31 10:58:52.169188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-2f819103-e725-47a5-b5cc-003098106737 req-8c21dcbf-475f-4be5-b005-7b124f9a3b88 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030932 Aug 31 10:58:52.170039 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 338/704] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:53.160911 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:53.161999 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:53.165250 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:53.166468 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:53.171308 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:53.171802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:53.172233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:53.172935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:53.173384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:53.173634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:53.173805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:53.174162 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:53.174606 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:53.175304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:53.175762 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:53.176177 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:53.375161 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:53.378492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:53.384211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d5602f13-3eb0-4caf-b5d1-b941df6b1a1d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1366 microversion: 2.1 time: 0.229426 Aug 31 10:58:53.384977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 367/705] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:53 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:53.387461 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-449e6c00-710e-4548-a51a-a28cd3cfcca3 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1318 microversion: 2.1 time: 0.230258 Aug 31 10:58:53.388016 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 339/706] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:53 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:54.406294 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:54.406857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:54.409035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:54.409870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:54.413921 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:54.414401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:54.414815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:54.415496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:54.415933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:54.416375 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:54.417099 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:54.417643 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:54.418149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:54.419069 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:54.419522 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:54.419969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:54.435531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:54.650487 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:54.656843 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:54.664678 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-72665433-e26b-4a7d-84d4-bb95d5a6aa7f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1366 microversion: 2.1 time: 0.262490 Aug 31 10:58:54.665566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 368/707] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:54 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:54.667231 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-46bc9093-b9c4-4d37-a270-0f42c0145c33 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1318 microversion: 2.1 time: 0.262704 Aug 31 10:58:54.667885 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 340/708] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:54 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:54.816684 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:54.819048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:54.825224 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:54.825722 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:54.826195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:54.826902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:54.827354 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:54.827774 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:54.852822 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lazy-loading 'flavor' on Instance uuid 80088fbb-9cea-4ee2-8224-ec783c4f9397 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:58:54.867836 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:54.998320 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-68df9318-366f-4ef2-81cb-5efcedcb70cc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/action" status: 200 len: 32 microversion: 2.1 time: 0.185571 Aug 31 10:58:54.998929 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 369/709] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:58:54 2022] POST /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 10:58:55.008500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:55.009107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:55.015308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:55.015782 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:55.016210 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:55.016889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:55.017338 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:55.017756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:55.164012 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:55.172483 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-38057ddc-d0be-49cd-bc6d-41bd5c2d398d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.167905 Aug 31 10:58:55.173051 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 341/710] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:55 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:55.686670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:55.687467 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:55.689678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:55.690846 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:55.694562 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:55.694993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:55.695426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:55.696133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:55.696588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:55.697009 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:55.697911 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:55.698489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:55.699027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:55.699825 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:55.700361 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:55.701798 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:55.903725 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:55.905992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:55.914269 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-95f8c85d-8024-4689-9ea5-933b252aae03 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1366 microversion: 2.1 time: 0.233094 Aug 31 10:58:55.914516 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-27979892-4c41-4588-8a77-b4973bf2fc7d tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1318 microversion: 2.1 time: 0.228990 Aug 31 10:58:55.914965 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 342/711] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:55 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:55.915110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 370/712] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:55 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:56.142736 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-0d9e880b-f9e1-420f-b093-b4bbeaa3145b req-7da7c110-c631-43d5-aeef-9a623bc5dd5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb34b296-2951-4f41-be97-703d0d35dfe4", "name": "network-vif-plugged", "status": "completed", "tag": "df151cfd-29a8-42f3-9cd6-315c1ca177f3"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:56.153216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-0d9e880b-f9e1-420f-b093-b4bbeaa3145b req-7da7c110-c631-43d5-aeef-9a623bc5dd5e service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:56.153696 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-0d9e880b-f9e1-420f-b093-b4bbeaa3145b req-7da7c110-c631-43d5-aeef-9a623bc5dd5e service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:56.154159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-0d9e880b-f9e1-420f-b093-b4bbeaa3145b req-7da7c110-c631-43d5-aeef-9a623bc5dd5e service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:56.165388 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-0d9e880b-f9e1-420f-b093-b4bbeaa3145b req-7da7c110-c631-43d5-aeef-9a623bc5dd5e service nova] Creating event network-vif-plugged:df151cfd-29a8-42f3-9cd6-315c1ca177f3 for instance cb34b296-2951-4f41-be97-703d0d35dfe4 on hv-cinder-79578 Aug 31 10:58:56.170477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-0d9e880b-f9e1-420f-b093-b4bbeaa3145b req-7da7c110-c631-43d5-aeef-9a623bc5dd5e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031356 Aug 31 10:58:56.171992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 371/713] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:56.194020 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:56.194640 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:56.201297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:56.201696 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:56.202157 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:56.202858 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:56.203312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:56.203759 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:56.348918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:56.357392 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-55834235-d612-4c6e-8d76-95aec87af178 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.167530 Aug 31 10:58:56.357986 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 343/714] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:56 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:56.935548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:56.936303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:56.936502 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:56.937172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:56.943190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:56.943674 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:56.943875 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:56.944132 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:56.944379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:56.944815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:56.944984 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:56.945264 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:56.945496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:56.945665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:56.945993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:56.946414 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:57.030847 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:57.057052 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=12 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:57.145233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:57.148860 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:57.153415 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0c300570-3541-4362-81cd-63e000d49cb9 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1366 microversion: 2.1 time: 0.221931 Aug 31 10:58:57.154081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 372/715] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:56 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:57.157340 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-34519063-cc7a-4641-abef-28660dc4bfab tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1506 microversion: 2.1 time: 0.226035 Aug 31 10:58:57.158101 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 344/716] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:56 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:57.177596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-81ad4050-35ed-419a-8bbf-9db0cc0ab269 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a61cb37-a61e-4e62-90d9-e59d2c6f09be", "device": "/dev/sdb"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:58:57.180564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-81ad4050-35ed-419a-8bbf-9db0cc0ab269 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:57.187209 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ad4050-35ed-419a-8bbf-9db0cc0ab269 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:57.187633 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ad4050-35ed-419a-8bbf-9db0cc0ab269 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:57.188064 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ad4050-35ed-419a-8bbf-9db0cc0ab269 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:57.188757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ad4050-35ed-419a-8bbf-9db0cc0ab269 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:57.189208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ad4050-35ed-419a-8bbf-9db0cc0ab269 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:57.189625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-81ad4050-35ed-419a-8bbf-9db0cc0ab269 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:57.190212 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=8 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:57.381125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:57.381813 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:57.389214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:57.389713 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:57.389876 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:57.390686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:57.391166 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:57.391624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:57.535690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:57.542829 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-81ad4050-35ed-419a-8bbf-9db0cc0ab269 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "POST /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369216 Aug 31 10:58:57.543476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 373/717] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 10:58:57 2022] POST /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:58:57.547354 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a993c497-40c2-4f0c-9b72-c0f4fab4d047 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.172545 Aug 31 10:58:57.547924 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 345/718] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:57 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:58.178828 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:58.179499 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:58.186148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:58.186651 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:58.187082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:58.187773 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:58.188221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:58.188640 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:58.325837 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:58.334154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-27504bd1-3380-45b3-bf51-5ca331e09d5d tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1366 microversion: 2.1 time: 0.160108 Aug 31 10:58:58.334741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 374/719] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:58 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:58.571091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:58.571863 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:58.578320 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:58.578812 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:58.579244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:58.579947 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:58.580401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:58.580821 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:58.719111 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:58.727611 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6234ce04-3bac-45fa-8a98-5185e3a05975 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.160583 Aug 31 10:58:58.728188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 346/720] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:58 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:59.359290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:59.360074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:59.366657 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:59.367135 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:59.367560 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:59.368230 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:59.368752 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:59.369283 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:59.508770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:59.517255 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-60154f60-acf9-47e4-b776-5e19401b5ef6 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1366 microversion: 2.1 time: 0.161970 Aug 31 10:58:59.517902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 375/721] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:59 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:58:59.749160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:58:59.749789 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:58:59.756861 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:59.757350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:59.757791 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:59.758512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:58:59.758968 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:58:59.759391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:58:59.908453 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:58:59.921221 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f1772ebe-c0bf-496f-8cae-7f1e76cbd31c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.176017 Aug 31 10:58:59.921804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 347/722] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:58:59 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:00.540339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:00.540920 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:00.548600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:00.549093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:00.549527 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:00.550256 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:00.550714 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:00.551141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:00.689540 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:00.697801 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-34df8736-6488-46ab-ab9b-5b82dbec9504 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1555 microversion: 2.1 time: 0.161554 Aug 31 10:59:00.698371 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 376/723] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:00 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:59:00.718165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-27870f48-c741-444a-83db-abe0469f5b9b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:00.718652 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-27870f48-c741-444a-83db-abe0469f5b9b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:00.724992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27870f48-c741-444a-83db-abe0469f5b9b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:00.725472 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27870f48-c741-444a-83db-abe0469f5b9b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:00.725939 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27870f48-c741-444a-83db-abe0469f5b9b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:00.726629 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27870f48-c741-444a-83db-abe0469f5b9b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:00.727074 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27870f48-c741-444a-83db-abe0469f5b9b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:00.727487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-27870f48-c741-444a-83db-abe0469f5b9b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:00.807972 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-27870f48-c741-444a-83db-abe0469f5b9b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093640 Aug 31 10:59:00.808586 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 348/724] 10.222.0.75 () {58 vars in 1275 bytes} [Wed Aug 31 10:59:00 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:00.944026 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:00.944816 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:00.951666 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:00.952233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:00.952757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:00.953624 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:00.954270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:00.954931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:01.228842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:01.237447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-480bd7b2-ce6f-4bc8-9352-eaad795a7294 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.297897 Aug 31 10:59:01.238249 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 377/725] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:00 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:01.852130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-18878bcc-2962-436a-a18d-3721f91295e3 req-ae0e93f5-fa02-4ac9-a15f-9964561a3281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb34b296-2951-4f41-be97-703d0d35dfe4", "tag": "df151cfd-29a8-42f3-9cd6-315c1ca177f3"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:01.861847 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-18878bcc-2962-436a-a18d-3721f91295e3 req-ae0e93f5-fa02-4ac9-a15f-9964561a3281 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:01.862328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-18878bcc-2962-436a-a18d-3721f91295e3 req-ae0e93f5-fa02-4ac9-a15f-9964561a3281 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:01.862880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-18878bcc-2962-436a-a18d-3721f91295e3 req-ae0e93f5-fa02-4ac9-a15f-9964561a3281 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:01.874568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-18878bcc-2962-436a-a18d-3721f91295e3 req-ae0e93f5-fa02-4ac9-a15f-9964561a3281 service nova] Creating event network-changed:df151cfd-29a8-42f3-9cd6-315c1ca177f3 for instance cb34b296-2951-4f41-be97-703d0d35dfe4 on hv-cinder-79578 Aug 31 10:59:01.880198 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-18878bcc-2962-436a-a18d-3721f91295e3 req-ae0e93f5-fa02-4ac9-a15f-9964561a3281 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032182 Aug 31 10:59:01.880760 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 349/726] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:02.260739 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:02.261677 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:02.268568 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:02.269191 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:02.269738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:02.270565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:02.271102 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:02.271754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:02.481608 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:02.490557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-806c2efe-5669-4e2b-948a-d980ca9a5366 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.233635 Aug 31 10:59:02.491149 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 378/727] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:02 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:03.513480 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:03.514069 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:03.521247 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:03.521726 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:03.522190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:03.522872 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:03.523318 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:03.523732 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:03.662997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:03.671702 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-09c6ad8f-8d9c-4d9c-8a53-0cd4318b8237 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.163078 Aug 31 10:59:03.672271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 350/728] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:03 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:04.693692 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:04.694324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:04.702504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:04.702994 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:04.703429 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:04.704126 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:04.704583 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:04.705003 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:04.849954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:04.858461 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8e1e185f-55a9-4319-87d5-9daabe4ac945 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.169432 Aug 31 10:59:04.859022 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 379/729] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:04 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:05.879810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:05.880423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:05.887347 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:05.887824 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:05.888262 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:05.888953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:05.889436 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:05.889889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:06.339445 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:06.351466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f7c385f9-7566-40dc-a948-75a6c8655b57 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.475297 Aug 31 10:59:06.352186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 351/730] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:05 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:07.375880 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:07.376511 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:07.379225 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:07.384700 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:07.385190 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:07.385600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:07.386340 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:07.386790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:07.387207 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:07.574369 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:07.582995 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-34b6564c-7fd1-4da9-beb0-389191cfd921 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.211025 Aug 31 10:59:07.583574 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 380/731] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:07 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:08.608853 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:08.609741 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:08.621627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:08.622572 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:08.623284 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:08.624418 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:08.625167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:08.625856 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:08.767772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:08.776510 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3c920eb2-9076-4e5f-95e3-e7fcf1b71d92 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.174423 Aug 31 10:59:08.777044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 352/732] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:08 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:09.801102 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:09.802028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:09.811920 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:09.812615 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:09.813235 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:09.814374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:09.814855 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:09.815284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:09.948877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:09.958978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4127bad1-635a-4ffe-814a-74b45609bca6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.163334 Aug 31 10:59:09.959635 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 381/733] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:09 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:10.985656 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:10.987002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:10.994025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:10.994516 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:10.994955 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:10.995657 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:10.996107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:10.996563 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:11.137745 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:11.148419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3e1a44aa-c9d4-4bbe-8cf8-873f838ad113 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.169280 Aug 31 10:59:11.148955 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 353/734] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:10 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:12.172745 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:12.173393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:12.183233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:12.184195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:12.184695 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:12.185652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:12.186319 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:12.186909 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:12.326496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:12.338864 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4f2feae6-7273-4b90-a6a8-06a3f482c9bd tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.172151 Aug 31 10:59:12.339508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 382/735] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:12 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:13.361181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:13.362058 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:13.364381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:13.370371 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:13.371001 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:13.371438 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:13.372121 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:13.372566 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:13.372982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:13.514980 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:13.527938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-efb753ea-fab3-4375-947c-e16cdf079d59 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.171334 Aug 31 10:59:13.528789 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 354/736] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:13 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:14.205418 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b9631c76-85a7-4aa0-873b-c417ef99f05e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:14.206056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b9631c76-85a7-4aa0-873b-c417ef99f05e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:14.212936 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9631c76-85a7-4aa0-873b-c417ef99f05e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:14.213489 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9631c76-85a7-4aa0-873b-c417ef99f05e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:14.213966 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9631c76-85a7-4aa0-873b-c417ef99f05e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:14.214667 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9631c76-85a7-4aa0-873b-c417ef99f05e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:14.215093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9631c76-85a7-4aa0-873b-c417ef99f05e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:14.215548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b9631c76-85a7-4aa0-873b-c417ef99f05e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:14.247785 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b9631c76-85a7-4aa0-873b-c417ef99f05e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments/b4e39e8a-5d7e-4b64-89a3-a8f6465a5eac" status: 200 len: 194 microversion: 2.20 time: 0.047595 Aug 31 10:59:14.248559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 383/737] 10.222.0.75 () {60 vars in 1454 bytes} [Wed Aug 31 10:59:14 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments/b4e39e8a-5d7e-4b64-89a3-a8f6465a5eac => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:14.318521 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:14.319014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:14.324899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:14.325376 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:14.325836 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:14.327156 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:14.327613 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:14.328025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:14.413256 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lazy-loading 'services' on Instance uuid a8fdb0f3-110c-4250-8dcc-e44426464c66 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:59:14.493739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1816ecfb-de0c-4e0b-a765-07c862fbabc7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments/b4e39e8a-5d7e-4b64-89a3-a8f6465a5eac" status: 202 len: 0 microversion: 2.20 time: 0.178889 Aug 31 10:59:14.494716 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 355/738] 10.222.0.75 () {60 vars in 1457 bytes} [Wed Aug 31 10:59:14 2022] DELETE /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments/b4e39e8a-5d7e-4b64-89a3-a8f6465a5eac => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:14.503502 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-52d78cd7-591a-4c28-8c11-869d59cca557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:14.507818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-52d78cd7-591a-4c28-8c11-869d59cca557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:14.516769 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-52d78cd7-591a-4c28-8c11-869d59cca557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:14.517344 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-52d78cd7-591a-4c28-8c11-869d59cca557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:14.517761 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-52d78cd7-591a-4c28-8c11-869d59cca557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:14.518577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-52d78cd7-591a-4c28-8c11-869d59cca557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:14.519117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-52d78cd7-591a-4c28-8c11-869d59cca557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:14.519639 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-52d78cd7-591a-4c28-8c11-869d59cca557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:14.523764 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.553250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-52d78cd7-591a-4c28-8c11-869d59cca557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053791 Aug 31 10:59:14.553662 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:14.554424 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:14.557520 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 384/739] 10.222.0.75 () {60 vars in 1343 bytes} [Wed Aug 31 10:59:14 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:14.562837 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:14.563575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:14.564187 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:14.564969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:14.565683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:14.566246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:14.705032 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:14.713377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-07bb280e-f144-47b7-8a69-04b9c486286c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.165627 Aug 31 10:59:14.713892 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 356/740] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:14 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:59:15.569469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-37fba4a5-8fb0-4ba2-9adb-9c345728522f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:15.573040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-37fba4a5-8fb0-4ba2-9adb-9c345728522f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:15.583284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-37fba4a5-8fb0-4ba2-9adb-9c345728522f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:15.583774 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-37fba4a5-8fb0-4ba2-9adb-9c345728522f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:15.584372 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-37fba4a5-8fb0-4ba2-9adb-9c345728522f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:15.585241 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-37fba4a5-8fb0-4ba2-9adb-9c345728522f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:15.585688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-37fba4a5-8fb0-4ba2-9adb-9c345728522f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:15.586138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-37fba4a5-8fb0-4ba2-9adb-9c345728522f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:15.619136 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-37fba4a5-8fb0-4ba2-9adb-9c345728522f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056438 Aug 31 10:59:15.619713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 385/741] 10.222.0.75 () {60 vars in 1343 bytes} [Wed Aug 31 10:59:15 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:15.734227 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:15.734829 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:15.741646 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:15.742172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:15.742608 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:15.743298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:15.743755 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:15.744180 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:15.759093 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.887974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:15.896215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bc788126-3101-4e7f-8a36-eb49e5f54833 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.165909 Aug 31 10:59:15.897047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 357/742] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:15 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:16.633070 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-10792659-460a-4cee-8b49-8e5309c24622 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:16.635113 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-10792659-460a-4cee-8b49-8e5309c24622 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:16.642193 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10792659-460a-4cee-8b49-8e5309c24622 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:16.642687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10792659-460a-4cee-8b49-8e5309c24622 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:16.643109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10792659-460a-4cee-8b49-8e5309c24622 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:16.643871 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10792659-460a-4cee-8b49-8e5309c24622 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:16.644363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10792659-460a-4cee-8b49-8e5309c24622 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:16.644799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-10792659-460a-4cee-8b49-8e5309c24622 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:16.675251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-10792659-460a-4cee-8b49-8e5309c24622 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046534 Aug 31 10:59:16.675842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 386/743] 10.222.0.75 () {60 vars in 1343 bytes} [Wed Aug 31 10:59:16 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:16.749317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:16.749899 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:16.757888 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:16.758383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:16.758820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:16.759534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:16.759987 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:16.760411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:16.787878 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:59:16.868014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e0b148e9-e771-4fa3-a22a-3c5aa510db0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 204 len: 0 microversion: 2.20 time: 0.124841 Aug 31 10:59:16.868602 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 358/744] 10.222.0.75 () {60 vars in 1280 bytes} [Wed Aug 31 10:59:16 2022] DELETE /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 10:59:16.878035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:16.878853 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:16.884897 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:16.885325 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:16.885758 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:16.886506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:16.886959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:16.887398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:16.919142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:16.919927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:16.926909 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:16.927430 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:16.928496 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:16.929199 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:16.929649 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:16.930138 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:17.076176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:17.085215 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:17.086661 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:17.087820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1ee3eeb2-3e24-425e-b4c6-66669f16c5b5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.214522 Aug 31 10:59:17.088585 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 387/745] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:16 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:17.106036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:17.114612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b1db8da4-6ec9-4159-90bf-0b40a5ff1ff1 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.199840 Aug 31 10:59:17.115172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 359/746] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:16 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:59:18.109093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:18.109630 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:18.110670 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:18.111309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:18.117071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:18.117682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:18.118039 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:18.118406 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:18.118547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:18.118935 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:18.119279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:18.119624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:18.119944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:18.120088 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:18.120473 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:18.120612 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:18.203793 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lazy-loading 'services' on Instance uuid bf3d3918-60f7-408a-86a7-efa330e561d0 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:59:18.253048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:18.262950 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:18.264542 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:18.265796 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d35e2ce5-3f25-4eee-9d92-d02f753b71d4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.158948 Aug 31 10:59:18.266334 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 360/747] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:18 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:18.281518 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0ca29c41-3d05-49dd-8461-c4442ee9d8e1 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "DELETE /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0/os-volume_attachments/9a61cb37-a61e-4e62-90d9-e59d2c6f09be" status: 202 len: 0 microversion: 2.1 time: 0.176224 Aug 31 10:59:18.282259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 388/748] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 10:59:18 2022] DELETE /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0/os-volume_attachments/9a61cb37-a61e-4e62-90d9-e59d2c6f09be => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:59:18.381623 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:18.382707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:18.391258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:18.392045 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:18.392757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:18.393539 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:18.394182 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:18.394633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:18.539869 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:18.548486 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-036a034e-d6f3-4f2b-94d2-8bb99d1af1a7 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.281175 Aug 31 10:59:18.549021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 361/749] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:18 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:19.290979 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:19.291758 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:19.298875 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:19.299363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:19.299792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:19.300526 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:19.300980 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:19.301417 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:19.441829 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:19.449996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:19.451545 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:19.452716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-eba69132-dfcf-4c12-a7df-f25dc0fbb5cb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.166998 Aug 31 10:59:19.453382 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 389/750] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:19 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:19.571374 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:19.572027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:19.578990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:19.579482 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:19.579918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:19.580627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:19.581087 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:19.581511 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:19.720804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:19.729528 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1a048898-6dcb-4b8a-8f85-0061e51066e8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.162426 Aug 31 10:59:19.730159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 362/751] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:19 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:20.477063 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:20.477709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:20.484587 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:20.485074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:20.485508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:20.486230 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:20.486681 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:20.487103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:20.622139 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:20.630512 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:20.631949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:20.633137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-64fbad2e-1aba-449c-a6c6-a72fcb2a7a27 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1723 microversion: 2.20 time: 0.160217 Aug 31 10:59:20.633716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 390/752] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:20 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:20.764572 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:20.765631 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:20.774686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:20.775170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:20.775604 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:20.776294 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:20.776740 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:20.777160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:20.931471 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:20.942464 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f8681aa1-50b5-4176-899c-d7d7cd56e194 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.184397 Aug 31 10:59:20.956095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 363/753] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:20 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:21.522557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:21.523133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:21.529943 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:21.530385 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:21.530820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:21.531546 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:21.531970 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:21.532392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:21.562855 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:59:21.650903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6a9a7319-21d4-4c51-8fee-c9aea01a31b7 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "DELETE /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 204 len: 0 microversion: 2.1 time: 0.131963 Aug 31 10:59:21.651677 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 391/754] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:59:21 2022] DELETE /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:21.656694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:21.657441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:21.660024 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:21.660732 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:21.667474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:21.668051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:21.668207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:21.668478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:21.669176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:21.669322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:21.669980 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:21.670526 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:21.670666 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:21.672018 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:21.675309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:21.675892 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:21.807143 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:21.818207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:21.819600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:21.820779 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-517a8158-6980-4dee-9f71-e8844cb9e2e5 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1655 microversion: 2.20 time: 0.168660 Aug 31 10:59:21.833991 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 364/755] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:21 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1655 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:21.910140 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:21.919528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3994b149-e6d6-4481-bd54-a3a23145f8c4 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1512 microversion: 2.1 time: 0.263490 Aug 31 10:59:21.934646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 392/756] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:21 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:59:21.958647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-0a27a836-df69-4521-b277-afe4afe0d2c2 req-ce59e756-7350-47c4-8a82-0b0e81e75b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fdb0f3-110c-4250-8dcc-e44426464c66", "name": "network-vif-deleted", "tag": "acef88c9-adeb-44f3-9d0f-359b56141283"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:21.963817 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:21.964455 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:21.969217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-0a27a836-df69-4521-b277-afe4afe0d2c2 req-ce59e756-7350-47c4-8a82-0b0e81e75b15 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:21.970032 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-0a27a836-df69-4521-b277-afe4afe0d2c2 req-ce59e756-7350-47c4-8a82-0b0e81e75b15 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:21.970858 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-0a27a836-df69-4521-b277-afe4afe0d2c2 req-ce59e756-7350-47c4-8a82-0b0e81e75b15 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:21.975626 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:21.976145 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:21.976578 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:21.978719 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:21.979195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:21.979627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:21.985221 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-0a27a836-df69-4521-b277-afe4afe0d2c2 req-ce59e756-7350-47c4-8a82-0b0e81e75b15 service nova] Creating event network-vif-deleted:acef88c9-adeb-44f3-9d0f-359b56141283 for instance a8fdb0f3-110c-4250-8dcc-e44426464c66 on hv-cinder-79578 Aug 31 10:59:21.990795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-0a27a836-df69-4521-b277-afe4afe0d2c2 req-ce59e756-7350-47c4-8a82-0b0e81e75b15 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036616 Aug 31 10:59:21.991896 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 365/757] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:22.155519 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:22.164092 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f5630fce-95d8-48ea-a4b4-54ef40f6c604 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.204180 Aug 31 10:59:22.164671 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 393/758] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:21 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:22.846032 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:22.847381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:22.854644 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:22.855358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:22.855874 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:22.856636 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:22.857129 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:22.857678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:22.924780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:22.933459 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:22.935295 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:22.936512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f1cce3b9-e8b5-4d35-9c83-70142c382e66 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1655 microversion: 2.20 time: 0.095429 Aug 31 10:59:22.937289 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 366/759] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:22 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:22.941708 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:22.942396 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:22.948529 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:22.949061 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:22.949523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:22.950252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:22.950699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:22.951117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:23.084548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:23.092485 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8249bf00-e516-48a3-8752-c8d0b64cb4cb tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1512 microversion: 2.1 time: 0.155352 Aug 31 10:59:23.094106 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 394/760] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:22 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:59:23.189697 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:23.190770 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:23.197719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:23.198235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:23.198673 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:23.199362 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:23.199819 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:23.200235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:23.339207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:23.348064 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-837ddaf2-1093-4f79-8d51-aa230c698df8 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.165238 Aug 31 10:59:23.348670 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 367/761] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:23 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:23.959745 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:23.960372 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:23.967269 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:23.967733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:23.968186 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:23.968875 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:23.969328 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:23.969748 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:24.035116 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:24.043978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:24.045410 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:24.046591 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-62843085-124b-41ca-8c3e-320981144db6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1367 microversion: 2.20 time: 0.090870 Aug 31 10:59:24.047129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 395/762] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:23 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:24.113704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:24.114690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:24.122060 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:24.122561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:24.122985 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:24.123679 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:24.124121 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:24.124538 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:24.262172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:24.270101 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3755d94e-2d79-4645-8a6b-3f7e96b076e6 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1512 microversion: 2.1 time: 0.160522 Aug 31 10:59:24.270664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 368/763] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:24 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:24.371111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:24.371699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:24.379142 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:24.379692 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:24.380162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:24.380955 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:24.381617 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:24.382115 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:24.520778 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:24.529548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4d8d42d5-32dc-4934-a48f-5e9ecd1dc06b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1735 microversion: 2.1 time: 0.162862 Aug 31 10:59:24.530132 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 396/764] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:24 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:25.069953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:25.070679 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:25.077757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.078372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.078862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.079697 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.080259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.080727 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.116633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.117228 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.117540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.118005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lazy-loading 'fault' on Instance uuid a8fdb0f3-110c-4250-8dcc-e44426464c66 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:59:25.196774 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:25.205082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:25.206996 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:25.208152 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4163f887-7034-4619-9191-a320be0e1c63 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 200 len: 1372 microversion: 2.20 time: 0.142362 Aug 31 10:59:25.211601 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 369/765] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:25 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 1372 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:25.291530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:25.292125 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:25.298851 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.299339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.299875 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.300540 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.300993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.301412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.517036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf2f9dbdcfe4cce91fd4c03cd8e8bba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff7c6e80bed43ecbcf17e4fa1bad450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:25.525249 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1020a60f-6bdc-4df9-9d90-e7f4b54ef9e2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 200 len: 1512 microversion: 2.1 time: 0.237782 Aug 31 10:59:25.525845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 397/766] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:25 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:25.551250 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:25.551999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:25.558747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.559584 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.560031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.560753 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.561215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.561624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.576357 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-48109b40-fea8-474b-b7a2-d8540cd7e209 req-ac96c7e2-76f3-4f05-a68a-01fa51a1dd74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf3d3918-60f7-408a-86a7-efa330e561d0", "name": "network-vif-deleted", "tag": "cb6e475d-a97e-4d4b-a11f-d4ae5e98f784"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:25.590629 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-48109b40-fea8-474b-b7a2-d8540cd7e209 req-ac96c7e2-76f3-4f05-a68a-01fa51a1dd74 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.591126 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-48109b40-fea8-474b-b7a2-d8540cd7e209 req-ac96c7e2-76f3-4f05-a68a-01fa51a1dd74 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.591762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-48109b40-fea8-474b-b7a2-d8540cd7e209 req-ac96c7e2-76f3-4f05-a68a-01fa51a1dd74 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.605581 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-48109b40-fea8-474b-b7a2-d8540cd7e209 req-ac96c7e2-76f3-4f05-a68a-01fa51a1dd74 service nova] Creating event network-vif-deleted:cb6e475d-a97e-4d4b-a11f-d4ae5e98f784 for instance bf3d3918-60f7-408a-86a7-efa330e561d0 on hv-cinder-79578 Aug 31 10:59:25.611665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-48109b40-fea8-474b-b7a2-d8540cd7e209 req-ac96c7e2-76f3-4f05-a68a-01fa51a1dd74 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039600 Aug 31 10:59:25.613322 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 398/767] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:59:25.707831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:25.717276 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a2d02238-b08f-4a7e-8976-5a04da2b312a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1715 microversion: 2.1 time: 0.170003 Aug 31 10:59:25.718364 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 370/768] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:25 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1715 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:25.783018 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:25.783599 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:25.790352 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.791005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.791440 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.792158 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.792595 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.793022 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.797174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:25.881202 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] HTTP exception thrown: Cannot 'detach_volume' instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 while it is in vm_state rescued Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Request method failure captured: Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: DELETE /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments/a08717e2-b9f6-48d4-be09-5454f716fbe2 HTTP/1.1 Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3bhecCROhg559l7k6U_enr0Hvh6lIA1bfD95Tam4VIDiIqYdoF7oCrVXCp1BhUt7gilM4vhdttkgI6BDDijC2mGNO8tfaQKHCjF2ZAj7_4FatiqrT1SoMiu_Q_DToTM8iektlE4E5SlylP897K-u16pRUV6d9X0fVtAb0wcS_Wql0 Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:59:25.882888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3aabb02cf14541f997b08fe0853acac0"}]}] Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 3dc4ac4ada004bbb942c36755f4a7cd1 Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:59:25.884211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Cannot 'detach_volume' instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 while it is in vm_state rescued Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'server_id': '80088fbb-9cea-4ee2-8224-ec783c4f9397', 'id': 'a08717e2-b9f6-48d4-be09-5454f716fbe2'} Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:25.884964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 while it is in vm_state rescued Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 while it is in vm_state rescued Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:25.886483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Returning 409 to user: Cannot 'detach_volume' instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 while it is in vm_state rescued {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:25.887674 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b6f90b9c-6af0-469a-8ade-c155d45eea1a tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "DELETE /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments/a08717e2-b9f6-48d4-be09-5454f716fbe2" status: 409 len: 152 microversion: 2.1 time: 0.105708 Aug 31 10:59:25.887674 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 399/769] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 10:59:25 2022] DELETE /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments/a08717e2-b9f6-48d4-be09-5454f716fbe2 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 10:59:25.893348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ac160fa3-1e35-47ce-ae36-39bce3ae3857 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:25.893908 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ac160fa3-1e35-47ce-ae36-39bce3ae3857 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:25.901127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ac160fa3-1e35-47ce-ae36-39bce3ae3857 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.901656 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ac160fa3-1e35-47ce-ae36-39bce3ae3857 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.902122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ac160fa3-1e35-47ce-ae36-39bce3ae3857 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.902813 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ac160fa3-1e35-47ce-ae36-39bce3ae3857 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.903269 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ac160fa3-1e35-47ce-ae36-39bce3ae3857 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.903691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ac160fa3-1e35-47ce-ae36-39bce3ae3857 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.963160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:25.976334 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ac160fa3-1e35-47ce-ae36-39bce3ae3857 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "POST /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/action" status: 202 len: 0 microversion: 2.1 time: 0.085999 Aug 31 10:59:25.976334 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 371/770] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:59:25 2022] POST /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:59:25.984552 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:25.985289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:25.992097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.992817 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.993438 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:25.994206 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:25.994820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:25.995461 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:26.232316 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:26.233009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:26.240841 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:26.241840 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:26.242453 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:26.243357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:26.243843 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:26.244552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:26.262199 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] HTTP exception thrown: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Request method failure captured: Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 HTTP/1.1 Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz4pLQDeZpE76epTiBTvXFBXGkH8xNxsmjRBcstQ5Jx8gPMXvM6uMvNxtmLrppsDA2U6NCYliPxgizYUhtoPDC4rHN0R9hiYKMWxbOBA7FQv-HDxqQMVUzHcT9l9lgA-JZMXEBZxU8estGcYC8NRmyXcRydZFhsWK0H2uZuo7RpmM5Y Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 10:59:26.263684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/81fc613102504ca1a7f12a1fceb2ed51"}]}] Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 324325d907f244beb6862df4116f2c78 Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 10:59:26.265097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'a8fdb0f3-110c-4250-8dcc-e44426464c66'} Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:26.266036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 10:59:26.267271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.268564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Returning 404 to user: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:26.268564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7e206713-758d-40c6-add5-9976ddf2b6b2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 404 len: 111 microversion: 2.20 time: 0.037696 Aug 31 10:59:26.268564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 372/771] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:26 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 10:59:26.274058 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bc8a758c-3aa9-46e9-b3f5-311ade2460d9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '.version_select at 0x7f37a8bb4ca0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:26.295970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bc8a758c-3aa9-46e9-b3f5-311ade2460d9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078277396" status: 204 len: 0 microversion: 2.20 time: 0.025694 Aug 31 10:59:26.296572 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 373/772] 10.222.0.75 () {60 vars in 1262 bytes} [Wed Aug 31 10:59:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078277396 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 10:59:26.318041 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:26.326978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-71c1dcc8-99b0-4721-8b19-32c753ec771e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1723 microversion: 2.1 time: 0.346394 Aug 31 10:59:26.327570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 400/773] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:25 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:26.547507 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:26.548095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] [instance: bf3d3918-60f7-408a-86a7-efa330e561d0] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:26.559955 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:26.560728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:26.561162 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:26.561906 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:26.562499 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:26.563035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:26.579199 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] HTTP exception thrown: Instance bf3d3918-60f7-408a-86a7-efa330e561d0 could not be found. Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Request method failure captured: Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 HTTP/1.1 Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz53htNOL6_T_U2T-UuByNgWpsfXX3IZuSQFHUvFippFJaf_KxjkSsPmhAi2YsXapzqX-i1uqLX7dc5PLZth-tBtACAsEA1Agf8XI0hl5Bn7hxYdzJMeLg6z1KvmCI561K-OF-3yAguXaGNc8mZ9DpGNdqEYZFLH7RHm5ii4y3k4Uj4 Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 4ff7c6e80bed43ecbcf17e4fa1bad450 Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-VolumesSnapshotTestJSON-506169213 Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 10:59:26.581070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_4ff7c6e80bed43ecbcf17e4fa1bad450"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/4ff7c6e80bed43ecbcf17e4fa1bad450"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/4ff7c6e80bed43ecbcf17e4fa1bad450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/4ff7c6e80bed43ecbcf17e4fa1bad450"}]}] Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-VolumesSnapshotTestJSON-506169213 Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 4ff7c6e80bed43ecbcf17e4fa1bad450 Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-506169213 Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-VolumesSnapshotTestJSON-506169213-project Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 9cf2f9dbdcfe4cce91fd4c03cd8e8bba Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-VolumesSnapshotTestJSON-506169213-project Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance bf3d3918-60f7-408a-86a7-efa330e561d0 could not be found. Aug 31 10:59:26.582756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'bf3d3918-60f7-408a-86a7-efa330e561d0'} Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf3d3918-60f7-408a-86a7-efa330e561d0 could not be found. Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:26.583470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf3d3918-60f7-408a-86a7-efa330e561d0 could not be found. Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf3d3918-60f7-408a-86a7-efa330e561d0 could not be found. Aug 31 10:59:26.584719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:26.587321 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] Returning 404 to user: Instance bf3d3918-60f7-408a-86a7-efa330e561d0 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:26.588435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ceca70db-ec7f-4b83-bfe8-4298de27c4a2 tempest-VolumesSnapshotTestJSON-506169213 tempest-VolumesSnapshotTestJSON-506169213-project] 10.222.0.75 "GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0" status: 404 len: 111 microversion: 2.1 time: 0.045400 Aug 31 10:59:26.589083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 374/774] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:26 2022] GET /compute/v2.1/servers/bf3d3918-60f7-408a-86a7-efa330e561d0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:59:27.047673 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f03f7059-6463-433f-adca-862ab1323280 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'create', calling method: .version_select at 0x7f37a8a080d0>, body: {"keypair": {"name": "tempest-keypair-1002983382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICz0YcagO/+HiOAFD8unrCuxnBOop/Lmu9c6CYeiUEHJ7pW4jxNDEdI6Zrq4NToOdA8BfVHDdBAosqIW1mP6TCcAYzUHNtM8eqcx1ug/3TYecWJKJev2CrYPMO1FQYejA=="}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:27.064209 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-f03f7059-6463-433f-adca-862ab1323280 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Getting quotas for project 81fc613102504ca1a7f12a1fceb2ed51. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:59:27.068065 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-f03f7059-6463-433f-adca-862ab1323280 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Getting quotas for user 324325d907f244beb6862df4116f2c78 and project 81fc613102504ca1a7f12a1fceb2ed51. Resources: {'key_pairs'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:59:27.093683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f03f7059-6463-433f-adca-862ab1323280 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050058 Aug 31 10:59:27.094337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 401/775] 10.222.0.75 () {62 vars in 1200 bytes} [Wed Aug 31 10:59:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 10:59:27.349092 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:27.349689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:27.356210 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:27.356686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:27.357110 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:27.357834 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:27.358291 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:27.358705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:27.540499 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:27.551473 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9f70e899-6dc5-41f0-b686-206d6bbb62dc tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1723 microversion: 2.1 time: 0.206866 Aug 31 10:59:27.552058 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 375/776] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:27 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:28.408958 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-865339536", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d5dea1a-cf96-44c4-b9f9-6117beb9295e"}], "security_groups": [{"name": "tempest-securitygroup--493244259"}], "key_name": "tempest-keypair-1002983382", "user_data": "}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:28.514555 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] validate_networks() for [('8d5dea1a-cf96-44c4-b9f9-6117beb9295e', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:59:28.572873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:28.573460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:28.580440 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:28.580910 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:28.581337 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:28.582088 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:28.582540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:28.582969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:28.772982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:28.781578 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0e888dd8-e1d9-4a05-b4f4-bd103d05cd86 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1723 microversion: 2.1 time: 0.212800 Aug 31 10:59:28.786055 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 376/777] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:28 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:59:29.255809 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:59:29.256355 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:59:29.256820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:59:29.257219 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:59:29.257624 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:59:29.267644 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:29.268164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:29.268653 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:29.269324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:29.269816 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:29.270271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:29.288107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Getting quotas for project 81fc613102504ca1a7f12a1fceb2ed51. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:59:29.292386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Getting quotas for user 324325d907f244beb6862df4116f2c78 and project 81fc613102504ca1a7f12a1fceb2ed51. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:59:29.304022 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:59:29.306358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:59:29.357619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0e3b563e-b3b0-4521-8b06-1b45f7f2e5e1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.953454 Aug 31 10:59:29.358340 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 402/778] 10.222.0.75 () {62 vars in 1188 bytes} [Wed Aug 31 10:59:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 10:59:29.369913 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-07176b2d-d781-4ee7-988c-6a5a5be97d6f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:29.370528 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-07176b2d-d781-4ee7-988c-6a5a5be97d6f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:29.423630 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-07176b2d-d781-4ee7-988c-6a5a5be97d6f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:29.432356 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-07176b2d-d781-4ee7-988c-6a5a5be97d6f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:29.433794 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-07176b2d-d781-4ee7-988c-6a5a5be97d6f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:29.435346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-07176b2d-d781-4ee7-988c-6a5a5be97d6f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1281 microversion: 2.20 time: 0.069617 Aug 31 10:59:29.435990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 377/779] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:29 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:29.803637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:29.804269 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:29.810763 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:29.811245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:29.811669 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:29.812381 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:29.812829 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:29.813242 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:29.950224 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:29.961482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-dbaa8313-f649-4a6f-b73c-838e460321ca tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1723 microversion: 2.1 time: 0.162702 Aug 31 10:59:29.962283 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 403/780] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:29 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:30.462422 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:30.463040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:30.470126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:30.470669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:30.471101 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:30.471995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:30.472452 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:30.472889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:30.541810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:30.553719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:30.555178 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:30.556363 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-df514ff2-d694-492b-8632-ca44d72aa817 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1285 microversion: 2.20 time: 0.098901 Aug 31 10:59:30.556918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 378/781] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:30 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:30.985232 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:30.986252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:30.995457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:30.996127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:30.996699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:30.997621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:30.998272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:30.998826 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:31.144832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:31.153786 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cb02fdcb-d4d8-4516-b769-515e2547bff9 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1723 microversion: 2.1 time: 0.173918 Aug 31 10:59:31.154375 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 404/782] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:30 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:31.573465 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d12f2fa8-55bd-4619-baef-cf5cf6f09165 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:31.576258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d12f2fa8-55bd-4619-baef-cf5cf6f09165 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:31.579490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:31.580349 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:31.583615 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d12f2fa8-55bd-4619-baef-cf5cf6f09165 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:31.584157 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d12f2fa8-55bd-4619-baef-cf5cf6f09165 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:31.584650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d12f2fa8-55bd-4619-baef-cf5cf6f09165 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:31.585339 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d12f2fa8-55bd-4619-baef-cf5cf6f09165 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:31.585809 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d12f2fa8-55bd-4619-baef-cf5cf6f09165 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:31.586237 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d12f2fa8-55bd-4619-baef-cf5cf6f09165 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:31.587652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:31.588663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:31.589296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:31.590278 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:31.590699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:31.591326 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:31.617368 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d12f2fa8-55bd-4619-baef-cf5cf6f09165 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047822 Aug 31 10:59:31.618154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 379/783] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 10:59:31 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 10:59:31.657917 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:31.666664 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:31.668074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:31.669230 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7cd4e05d-c7ef-47a6-b280-7daa30d6af49 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1333 microversion: 2.20 time: 0.094233 Aug 31 10:59:31.669780 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 405/784] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:31 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:59:31.682070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:31.682572 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:31.689033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:31.689535 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:31.690001 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:31.690710 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:31.691802 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:31.692250 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:31.717816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:59:31.796514 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4a033c6d-9fcc-4350-b526-8ebc7668dfb9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "DELETE /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 204 len: 0 microversion: 2.1 time: 0.117989 Aug 31 10:59:31.797144 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 380/785] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:59:31 2022] DELETE /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 10:59:31.806379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:31.807254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:31.814097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:31.814579 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:31.815007 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:31.815704 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:31.816141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:31.816551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:31.962742 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:31.974866 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a14374e5-873a-4961-869b-fcfe1eb9f040 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1675 microversion: 2.1 time: 0.172576 Aug 31 10:59:31.975632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 406/786] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:31 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:32.176290 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:32.177036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:32.183218 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:32.183706 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:32.184142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:32.185144 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:32.185600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:32.186051 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:32.335953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:32.345250 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ea4fe3d1-1253-46c4-9d15-2f6123dcb784 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1729 microversion: 2.1 time: 0.173323 Aug 31 10:59:32.346237 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 381/787] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:32 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:32.369130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-53c1479a-468d-4e2e-9f00-b7e59c3dcef3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:32.369622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-53c1479a-468d-4e2e-9f00-b7e59c3dcef3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:32.376059 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-53c1479a-468d-4e2e-9f00-b7e59c3dcef3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:32.376623 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-53c1479a-468d-4e2e-9f00-b7e59c3dcef3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:32.377098 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-53c1479a-468d-4e2e-9f00-b7e59c3dcef3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:32.377978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-53c1479a-468d-4e2e-9f00-b7e59c3dcef3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:32.379363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-53c1479a-468d-4e2e-9f00-b7e59c3dcef3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:32.380084 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-53c1479a-468d-4e2e-9f00-b7e59c3dcef3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:32.459518 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-53c1479a-468d-4e2e-9f00-b7e59c3dcef3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094932 Aug 31 10:59:32.460389 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 407/788] 10.222.0.75 () {58 vars in 1275 bytes} [Wed Aug 31 10:59:32 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:32.691612 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:32.692224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:32.699677 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:32.700172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:32.700609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:32.701309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:32.701757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:32.702260 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:32.799366 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:32.808205 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:32.810019 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:32.811162 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2ad882ee-c9e0-447d-8ee8-89ac8c649381 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1333 microversion: 2.20 time: 0.123680 Aug 31 10:59:32.811754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 382/789] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:32 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:33.001478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:33.002193 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:33.008799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:33.009295 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:33.009726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:33.010469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:33.010930 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:33.011358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:33.233018 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:33.241317 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-581f712a-6693-4285-b6e3-f8e2b1ba3187 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1675 microversion: 2.1 time: 0.244432 Aug 31 10:59:33.241913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 408/790] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:32 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:33.488107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-c28e8a2f-30b1-4229-9d56-105aa9104ff7 req-3be2160f-59a4-4bda-91eb-fa2d9818c0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80088fbb-9cea-4ee2-8224-ec783c4f9397", "tag": "64257485-56f5-4b89-a0a9-09ac5a18b844"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:33.498717 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-c28e8a2f-30b1-4229-9d56-105aa9104ff7 req-3be2160f-59a4-4bda-91eb-fa2d9818c0c9 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:33.499423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-c28e8a2f-30b1-4229-9d56-105aa9104ff7 req-3be2160f-59a4-4bda-91eb-fa2d9818c0c9 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:33.500046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-c28e8a2f-30b1-4229-9d56-105aa9104ff7 req-3be2160f-59a4-4bda-91eb-fa2d9818c0c9 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:33.512465 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-c28e8a2f-30b1-4229-9d56-105aa9104ff7 req-3be2160f-59a4-4bda-91eb-fa2d9818c0c9 service nova] Creating event network-changed:64257485-56f5-4b89-a0a9-09ac5a18b844 for instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 on hv-cinder-79578 Aug 31 10:59:33.518283 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-c28e8a2f-30b1-4229-9d56-105aa9104ff7 req-3be2160f-59a4-4bda-91eb-fa2d9818c0c9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033870 Aug 31 10:59:33.518892 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 383/791] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:33.832640 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:33.833261 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:33.839638 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:33.840131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:33.840563 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:33.841413 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:33.846386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:33.846386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:33.912815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:33.921093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:33.922562 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:33.923660 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9c3d49a0-f0bc-4f99-9c63-8970cbfc1eac tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1333 microversion: 2.20 time: 0.095273 Aug 31 10:59:33.930931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 409/792] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:33 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:34.264981 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:34.265685 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:34.272907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:34.273408 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:34.273843 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:34.274596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:34.275043 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:34.275466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:34.422647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:34.432637 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ad638801-1fd7-4293-9b9b-7abcaeea69de tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1675 microversion: 2.1 time: 0.172238 Aug 31 10:59:34.433444 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 384/793] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:34 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:34.946579 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:34.947187 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:34.954099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:34.954576 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:34.955035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:34.955753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:34.956410 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:34.956842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:35.022918 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:35.031212 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:35.032611 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:35.033738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4e501784-f867-4114-8af1-d421f3be7ba8 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1333 microversion: 2.20 time: 0.091142 Aug 31 10:59:35.034541 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 410/794] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:34 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:35.455454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:35.456202 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:35.463471 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:35.463964 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:35.464403 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:35.465108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:35.465719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:35.466233 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:35.568382 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-8ae8d0b0-6fc8-4984-b3fd-75e29081fa13 req-2b69c51f-7f96-40ca-a9a7-bf6d5682ba88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80088fbb-9cea-4ee2-8224-ec783c4f9397", "tag": "64257485-56f5-4b89-a0a9-09ac5a18b844"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:35.578265 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-8ae8d0b0-6fc8-4984-b3fd-75e29081fa13 req-2b69c51f-7f96-40ca-a9a7-bf6d5682ba88 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:35.578765 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-8ae8d0b0-6fc8-4984-b3fd-75e29081fa13 req-2b69c51f-7f96-40ca-a9a7-bf6d5682ba88 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:35.579194 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-8ae8d0b0-6fc8-4984-b3fd-75e29081fa13 req-2b69c51f-7f96-40ca-a9a7-bf6d5682ba88 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:35.590405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-8ae8d0b0-6fc8-4984-b3fd-75e29081fa13 req-2b69c51f-7f96-40ca-a9a7-bf6d5682ba88 service nova] Creating event network-changed:64257485-56f5-4b89-a0a9-09ac5a18b844 for instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 on hv-cinder-79578 Aug 31 10:59:35.595684 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-8ae8d0b0-6fc8-4984-b3fd-75e29081fa13 req-2b69c51f-7f96-40ca-a9a7-bf6d5682ba88 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031038 Aug 31 10:59:35.596281 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 411/795] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:35.865116 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:35.873186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-64cd27e1-aa1c-423e-9204-54dbe52fa75b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1675 microversion: 2.1 time: 0.421776 Aug 31 10:59:35.873779 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 385/796] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:35 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1675 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:36.058841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:36.059775 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:36.066532 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:36.067014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:36.067448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:36.068142 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:36.068627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:36.069054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:36.435451 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:36.446790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:36.448291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:36.449521 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cd33bee7-d016-496b-ba9f-e33573838176 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1339 microversion: 2.20 time: 0.396587 Aug 31 10:59:36.450143 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 412/797] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:36 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1339 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:36.894934 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:36.896388 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:36.904056 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:36.904533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:36.904984 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:36.905727 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:36.906207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:36.906632 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:37.041140 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:37.049424 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bebdb774-2f7b-427d-9c8f-023241a54582 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1607 microversion: 2.1 time: 0.158506 Aug 31 10:59:37.050052 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 386/798] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:36 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1607 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:37.472865 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:37.476621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:37.485518 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:37.487748 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:37.488372 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:37.490739 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:37.491496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:37.491959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:37.492589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:37.645424 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:37.659683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:37.661597 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:37.663333 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-917dc4e5-f368-4414-b4cb-dd7e880e319b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1406 microversion: 2.20 time: 0.194463 Aug 31 10:59:37.664099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 413/799] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:37 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:37.699742 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-21e1b58b-5cbf-438b-bc58-d23a4df2892d req-c7ee532b-f507-4298-a5a2-bbf71ee63e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62fc001e-fe00-44da-8493-aaf6fc2cd297", "name": "network-vif-deleted", "tag": "da85246a-ae6a-4642-84f1-fc043b95c9b2"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:37.710699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-21e1b58b-5cbf-438b-bc58-d23a4df2892d req-c7ee532b-f507-4298-a5a2-bbf71ee63e11 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:37.711191 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-21e1b58b-5cbf-438b-bc58-d23a4df2892d req-c7ee532b-f507-4298-a5a2-bbf71ee63e11 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:37.711624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-21e1b58b-5cbf-438b-bc58-d23a4df2892d req-c7ee532b-f507-4298-a5a2-bbf71ee63e11 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:37.725485 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-21e1b58b-5cbf-438b-bc58-d23a4df2892d req-c7ee532b-f507-4298-a5a2-bbf71ee63e11 service nova] Creating event network-vif-deleted:da85246a-ae6a-4642-84f1-fc043b95c9b2 for instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 on hv-cinder-79578 Aug 31 10:59:37.730441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-21e1b58b-5cbf-438b-bc58-d23a4df2892d req-c7ee532b-f507-4298-a5a2-bbf71ee63e11 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116293 Aug 31 10:59:37.731040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 387/800] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:38.074323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:38.074945 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:38.084856 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:38.085336 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:38.085793 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:38.086662 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:38.087120 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:38.087542 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:38.161869 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:38.170116 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9beb4254-b01b-426f-bf82-7b81b4e5e93a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1607 microversion: 2.1 time: 0.100430 Aug 31 10:59:38.170728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 414/801] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:38 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1607 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:38.692457 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:38.693608 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:38.704495 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:38.705297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:38.706087 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:38.707258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:38.708020 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:38.708720 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:38.851533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:38.860141 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:38.861576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:38.862733 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5ba5d2d3-17df-4bbb-8212-978a27795bff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1406 microversion: 2.20 time: 0.178697 Aug 31 10:59:38.863361 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 388/802] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:38 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:39.195892 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:39.196807 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:39.207919 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:39.208726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:39.209447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:39.210646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:39.211416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:39.212110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:39.276266 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:39.285069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:39.296980 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ec1278e1-a6ef-48b5-8421-f713b33a1c53 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1607 microversion: 2.1 time: 0.107534 Aug 31 10:59:39.297812 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 415/803] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:39 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1607 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:39.886836 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:39.887638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:39.895005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:39.898091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:39.899503 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:39.900276 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:39.901262 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:39.902944 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:39.903556 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:40.239388 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:40.248213 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:40.249634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:40.250773 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-06d465f4-4800-4e83-9651-a633651eb6c9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1406 microversion: 2.20 time: 0.369310 Aug 31 10:59:40.251346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 389/804] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:39 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:40.319338 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:40.320015 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:40.322039 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=10 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:40.328373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:40.328876 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:40.329310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:40.330090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:40.330550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:40.330973 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:40.365496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:40.366003 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:40.366433 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:40.366989 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lazy-loading 'fault' on Instance uuid 62fc001e-fe00-44da-8493-aaf6fc2cd297 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:59:40.432601 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:40.441504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-97ff4eb4-fb5c-4fe5-a4b4-a49bf4af4732 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 200 len: 1328 microversion: 2.1 time: 0.126297 Aug 31 10:59:40.442348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 416/805] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:40 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 1328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:40.581326 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-dbfdf6a4-09c4-4137-8a90-32babdcd2b1b req-f1275d55-ce42-418f-b8eb-ef5bac76957e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd1f4b3-b876-4694-879d-791fb851a085", "tag": "13802481-258c-4015-b25a-d35749ab72e3"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:40.602581 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-dbfdf6a4-09c4-4137-8a90-32babdcd2b1b req-f1275d55-ce42-418f-b8eb-ef5bac76957e service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:40.603396 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-dbfdf6a4-09c4-4137-8a90-32babdcd2b1b req-f1275d55-ce42-418f-b8eb-ef5bac76957e service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:40.603840 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-dbfdf6a4-09c4-4137-8a90-32babdcd2b1b req-f1275d55-ce42-418f-b8eb-ef5bac76957e service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:40.618780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-dbfdf6a4-09c4-4137-8a90-32babdcd2b1b req-f1275d55-ce42-418f-b8eb-ef5bac76957e service nova] Creating event network-changed:13802481-258c-4015-b25a-d35749ab72e3 for instance 1cd1f4b3-b876-4694-879d-791fb851a085 on hv-cinder-79578 Aug 31 10:59:40.625079 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-dbfdf6a4-09c4-4137-8a90-32babdcd2b1b req-f1275d55-ce42-418f-b8eb-ef5bac76957e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047369 Aug 31 10:59:40.626547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 390/806] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:41.277701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:41.278931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:41.289049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:41.289573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:41.290045 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:41.290754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:41.291209 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:41.291637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:41.435671 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:41.445515 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:41.446962 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:41.448088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-77e783e5-e83e-4bbc-81b0-e7c903024d67 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1406 microversion: 2.20 time: 0.177301 Aug 31 10:59:41.448649 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 417/807] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:41 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:41.463819 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:41.464520 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:41.471235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:41.471738 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:41.472313 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:41.473024 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:41.473482 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:41.473944 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:41.487823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] HTTP exception thrown: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Request method failure captured: Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 HTTP/1.1 Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3XUiRhnkMZBkslrexasVHr3ldD7vHChhlU6vvjN4se-XHj1LVD14G2JGtzYwVlGR8JpLm-vZA71Iaj2ZHdpNzFI61KFdeD5NkPJy7leM07s0vRGa1BmSCVOzpbKCxd5KAwAY8mkzAPcbhxHPNPZ4JMbPE28L77x_-q2yX5hjmuhLs Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 10:59:41.489441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}] Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeTestJSON-954782868 Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeTestJSON-954782868-project Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: cbb16c0b86444a59ab299013c694cb07 Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeTestJSON-954782868-project Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 10:59:41.491167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '62fc001e-fe00-44da-8493-aaf6fc2cd297'} Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:41.492259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 10:59:41.493893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:41.495285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Returning 404 to user: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:41.495285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4805d278-f245-44c0-ba5d-024fbe99457a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 404 len: 111 microversion: 2.1 time: 0.031834 Aug 31 10:59:41.495285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 391/808] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:41 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:59:41.500234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8ae5b4de-7cd8-4d6a-86dc-5d8d9b6d7793 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '.version_select at 0x7f37a8b773a0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:41.521898 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8ae5b4de-7cd8-4d6a-86dc-5d8d9b6d7793 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731906644" status: 202 len: 0 microversion: 2.1 time: 0.025557 Aug 31 10:59:41.522476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 418/809] 10.222.0.75 () {58 vars in 1221 bytes} [Wed Aug 31 10:59:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731906644 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:59:42.216438 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0aecafc8-6f4f-4e41-bb82-a35397f55ec8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'create', calling method: .version_select at 0x7f37a8bba1f0>, body: {"keypair": {"name": "tempest-keypair-1523580971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzu3JNsgbeaKxAWPEDCCNRY24jcjhhWp0HoJZHrovFEmH36bQyRtZkMAH1EkO392dnnwUELH/iRA0EsrDJwO710xnJKUkvbb5EausJG8K3mN1oQdea4EGH0bgIilfehaA=="}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:42.232185 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-0aecafc8-6f4f-4e41-bb82-a35397f55ec8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Getting quotas for project dd581788f9ca4c2fb1ba3fe02f34b29d. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:59:42.236362 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-0aecafc8-6f4f-4e41-bb82-a35397f55ec8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Getting quotas for user cbb16c0b86444a59ab299013c694cb07 and project dd581788f9ca4c2fb1ba3fe02f34b29d. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:59:42.238851 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:42.263277 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0aecafc8-6f4f-4e41-bb82-a35397f55ec8 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050047 Aug 31 10:59:42.263825 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 392/810] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 10:59:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:42.471329 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:42.471930 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:42.478330 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:42.478842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:42.479466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:42.480398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:42.480859 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:42.481284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:42.486625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=100 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:42.721834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:42.731103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:42.732522 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:42.733689 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d2a07112-1f39-420c-b36a-1f12f331b2eb tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1406 microversion: 2.20 time: 0.267244 Aug 31 10:59:42.734297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 419/811] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:42 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:43.767789 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:43.767789 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:43.773203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1255351952", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bef1d45c-b826-4be6-8c9e-24871b00faaa"}], "security_groups": [{"name": "tempest-securitygroup--1512131175"}], "key_name": "tempest-keypair-1523580971", "user_data": "}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:43.775115 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:43.775603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:43.776024 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:43.776738 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:43.777188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:43.777586 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:43.935292 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] validate_networks() for [('bef1d45c-b826-4be6-8c9e-24871b00faaa', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 10:59:44.012226 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:44.014573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:44.024805 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:44.027167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:44.028599 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a9010267-9856-47cf-a1a2-f995374155ca tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1406 microversion: 2.20 time: 0.269085 Aug 31 10:59:44.029377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 393/812] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:43 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:44.365221 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1509503643"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:44.366405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:44.373293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:44.373960 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:44.374481 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:44.375241 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:44.375948 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:44.376492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:44.591052 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.network.security_group_api [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Removing security group 8b5458d0-0185-4f91-8efd-28cb5528b0d2 from port ad172ad1-ff5a-4d9c-8473-07c7509a5e88 Aug 31 10:59:44.758549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 10:59:44.759005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 10:59:44.759481 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 10:59:44.759840 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 10:59:44.760253 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 10:59:44.770236 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:44.770732 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:44.771171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:44.771899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:44.772356 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:44.772800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:44.790729 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Getting quotas for project dd581788f9ca4c2fb1ba3fe02f34b29d. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 10:59:44.795199 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Getting quotas for user cbb16c0b86444a59ab299013c694cb07 and project dd581788f9ca4c2fb1ba3fe02f34b29d. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 10:59:44.807425 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 10:59:44.811756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 10:59:44.863753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2290d328-1650-4273-80b5-0bc665a79230 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.094832 Aug 31 10:59:44.864426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 420/813] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 10:59:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 10:59:44.875573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-014e335d-0b15-4cf0-a7eb-b7ce09adfee6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:44.876188 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-014e335d-0b15-4cf0-a7eb-b7ce09adfee6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:44.944560 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-014e335d-0b15-4cf0-a7eb-b7ce09adfee6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:44.952728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-014e335d-0b15-4cf0-a7eb-b7ce09adfee6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1238 microversion: 2.1 time: 0.080860 Aug 31 10:59:44.953204 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 421/814] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:44 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:45.015928 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-41037647-005e-449f-bc9e-ea146f99ae92 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "POST /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/action" status: 202 len: 0 microversion: 2.1 time: 0.655096 Aug 31 10:59:45.016573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 394/815] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 10:59:44 2022] POST /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:59:45.029644 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-42ac3857-2597-4376-864a-bc03b43d82c4 req-0e95742b-20c9-4a04-b40c-8feaa61fc61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c57211-e6e0-4f67-9029-1806387921e7", "tag": "ad172ad1-ff5a-4d9c-8473-07c7509a5e88"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:45.040404 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-42ac3857-2597-4376-864a-bc03b43d82c4 req-0e95742b-20c9-4a04-b40c-8feaa61fc61d service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:45.041233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-42ac3857-2597-4376-864a-bc03b43d82c4 req-0e95742b-20c9-4a04-b40c-8feaa61fc61d service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:45.041854 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-42ac3857-2597-4376-864a-bc03b43d82c4 req-0e95742b-20c9-4a04-b40c-8feaa61fc61d service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:45.053344 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:45.054293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:45.065704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:45.066257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:45.066659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:45.067378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:45.067990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:45.068419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:45.080183 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-42ac3857-2597-4376-864a-bc03b43d82c4 req-0e95742b-20c9-4a04-b40c-8feaa61fc61d service nova] Creating event network-changed:ad172ad1-ff5a-4d9c-8473-07c7509a5e88 for instance c6c57211-e6e0-4f67-9029-1806387921e7 on hv-cinder-79578 Aug 31 10:59:45.096154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-42ac3857-2597-4376-864a-bc03b43d82c4 req-0e95742b-20c9-4a04-b40c-8feaa61fc61d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070051 Aug 31 10:59:45.097532 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 422/816] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:45.388459 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:45.407649 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:45.421246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:45.425476 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-65fb3096-7540-4931-8033-94408a628a05 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1406 microversion: 2.20 time: 0.377825 Aug 31 10:59:45.431335 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 395/817] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:45 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 10:59:45.974142 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:45.975486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:45.983137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:45.983751 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:45.984357 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:45.985088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:45.985536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:45.985950 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:46.091595 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:46.100138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d31832f4-10db-45ec-9637-ac4395d817cb tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1290 microversion: 2.1 time: 0.130925 Aug 31 10:59:46.101394 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 423/818] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:45 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1290 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:46.178222 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-a86e490c-6f95-4163-8c84-f1862f3fe5c4 req-8b4314fb-491f-46b9-b967-ec2ab08549a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd1f4b3-b876-4694-879d-791fb851a085", "name": "network-vif-plugged", "status": "completed", "tag": "13802481-258c-4015-b25a-d35749ab72e3"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:46.190767 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-a86e490c-6f95-4163-8c84-f1862f3fe5c4 req-8b4314fb-491f-46b9-b967-ec2ab08549a4 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:46.191491 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-a86e490c-6f95-4163-8c84-f1862f3fe5c4 req-8b4314fb-491f-46b9-b967-ec2ab08549a4 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:46.192107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-a86e490c-6f95-4163-8c84-f1862f3fe5c4 req-8b4314fb-491f-46b9-b967-ec2ab08549a4 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:46.207687 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-a86e490c-6f95-4163-8c84-f1862f3fe5c4 req-8b4314fb-491f-46b9-b967-ec2ab08549a4 service nova] Creating event network-vif-plugged:13802481-258c-4015-b25a-d35749ab72e3 for instance 1cd1f4b3-b876-4694-879d-791fb851a085 on hv-cinder-79578 Aug 31 10:59:46.213895 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-a86e490c-6f95-4163-8c84-f1862f3fe5c4 req-8b4314fb-491f-46b9-b967-ec2ab08549a4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041115 Aug 31 10:59:46.215051 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 396/819] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:46.454822 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:46.455425 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:46.463136 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:46.463987 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:46.464496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:46.465672 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:46.466226 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:46.466758 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:46.787846 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:46.796051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:46.797600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:46.798975 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1980eca6-b624-453a-b642-1b01442d1518 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1406 microversion: 2.20 time: 0.348112 Aug 31 10:59:46.799607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 424/820] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:46 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1406 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:46.937540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:46.938152 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:46.945241 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:46.945819 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:46.946273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:46.947028 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:46.947487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:46.947955 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:47.051311 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lazy-loading 'services' on Instance uuid c6c57211-e6e0-4f67-9029-1806387921e7 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:59:47.121196 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-e43ef1df-d376-4f67-bfda-4e6c8e57671b req-50e4b4ab-8c2c-481b-ae42-30d5342890af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c57211-e6e0-4f67-9029-1806387921e7", "tag": "ad172ad1-ff5a-4d9c-8473-07c7509a5e88"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:47.133307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-e43ef1df-d376-4f67-bfda-4e6c8e57671b req-50e4b4ab-8c2c-481b-ae42-30d5342890af service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:47.133799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-e43ef1df-d376-4f67-bfda-4e6c8e57671b req-50e4b4ab-8c2c-481b-ae42-30d5342890af service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:47.134397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-e43ef1df-d376-4f67-bfda-4e6c8e57671b req-50e4b4ab-8c2c-481b-ae42-30d5342890af service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:47.146549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a12e2858-9db1-47bf-a15c-e449134c242d tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments/717902b9-3aef-436a-97cf-9ab12af3f43f" status: 202 len: 0 microversion: 2.1 time: 0.213575 Aug 31 10:59:47.147446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-e43ef1df-d376-4f67-bfda-4e6c8e57671b req-50e4b4ab-8c2c-481b-ae42-30d5342890af service nova] Creating event network-changed:ad172ad1-ff5a-4d9c-8473-07c7509a5e88 for instance c6c57211-e6e0-4f67-9029-1806387921e7 on hv-cinder-79578 Aug 31 10:59:47.147676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 397/821] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 10:59:46 2022] DELETE /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments/717902b9-3aef-436a-97cf-9ab12af3f43f => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:59:47.155261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:47.160683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-e43ef1df-d376-4f67-bfda-4e6c8e57671b req-50e4b4ab-8c2c-481b-ae42-30d5342890af service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043788 Aug 31 10:59:47.161558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 425/822] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 10:59:47.166178 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:47.175674 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:47.176463 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:47.177106 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:47.178233 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:47.178901 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:47.180023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:47.180667 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9ce34a95-8035-4a21-b0f6-c4468cb400c7 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:47.188079 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9ce34a95-8035-4a21-b0f6-c4468cb400c7 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:47.206547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9ce34a95-8035-4a21-b0f6-c4468cb400c7 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:47.207063 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9ce34a95-8035-4a21-b0f6-c4468cb400c7 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:47.207511 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9ce34a95-8035-4a21-b0f6-c4468cb400c7 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:47.208780 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9ce34a95-8035-4a21-b0f6-c4468cb400c7 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:47.209242 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9ce34a95-8035-4a21-b0f6-c4468cb400c7 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:47.209669 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9ce34a95-8035-4a21-b0f6-c4468cb400c7 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:47.246158 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9ce34a95-8035-4a21-b0f6-c4468cb400c7 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080776 Aug 31 10:59:47.246744 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 426/823] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 10:59:47 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:47.272809 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:47.283015 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bb526de9-419e-4c9d-86cc-5b00f1606ccd tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1296 microversion: 2.1 time: 0.134010 Aug 31 10:59:47.283600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 398/824] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:47 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1296 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:47.821142 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:47.822039 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:47.834961 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:47.835584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:47.835985 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:47.837362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:47.838031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:47.838451 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:48.086998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:48.097097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:48.098676 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:48.100289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-94996f3f-42a7-4d35-b408-b8d5b22de8f1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1406 microversion: 2.20 time: 0.283179 Aug 31 10:59:48.101119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 427/825] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:47 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:48.260929 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0da1a183-8a2e-40a1-91c6-f00e810d9231 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:48.265344 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0da1a183-8a2e-40a1-91c6-f00e810d9231 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:48.279302 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0da1a183-8a2e-40a1-91c6-f00e810d9231 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:48.280257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0da1a183-8a2e-40a1-91c6-f00e810d9231 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:48.280778 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0da1a183-8a2e-40a1-91c6-f00e810d9231 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:48.281614 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0da1a183-8a2e-40a1-91c6-f00e810d9231 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:48.282154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0da1a183-8a2e-40a1-91c6-f00e810d9231 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:48.282642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0da1a183-8a2e-40a1-91c6-f00e810d9231 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:48.305882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:48.314031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:48.323670 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0da1a183-8a2e-40a1-91c6-f00e810d9231 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068367 Aug 31 10:59:48.324595 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 399/826] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 10:59:48 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:48.335400 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:48.335834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:48.336262 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:48.337004 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:48.337458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:48.337916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:48.622305 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:48.630796 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-970aa373-7a93-4ee2-a95e-f9d610de583c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1364 microversion: 2.1 time: 0.329076 Aug 31 10:59:48.631378 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 428/827] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:48 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:59:49.123727 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:49.124418 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:49.132766 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.133355 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.134051 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.134801 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.135254 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.135878 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.336358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e0e9ffc2-2d31-4136-974e-00fe08a8d725 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:49.338568 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e0e9ffc2-2d31-4136-974e-00fe08a8d725 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:49.346544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0e9ffc2-2d31-4136-974e-00fe08a8d725 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.347384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0e9ffc2-2d31-4136-974e-00fe08a8d725 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.347860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0e9ffc2-2d31-4136-974e-00fe08a8d725 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.348776 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0e9ffc2-2d31-4136-974e-00fe08a8d725 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.349261 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0e9ffc2-2d31-4136-974e-00fe08a8d725 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.349704 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0e9ffc2-2d31-4136-974e-00fe08a8d725 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.380541 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e0e9ffc2-2d31-4136-974e-00fe08a8d725 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048252 Aug 31 10:59:49.381186 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 429/828] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 10:59:49 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 10:59:49.392586 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-2b2719ef-2277-4d81-8e0d-e5c886afb54e req-f8ebaeae-f51f-4f03-9dff-702a88e478fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175e5c4c-5bf1-44fb-81aa-7268900587c1", "tag": "e5e74a0f-e2bc-43c1-b648-b96bf8f85107"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:49.403195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-2b2719ef-2277-4d81-8e0d-e5c886afb54e req-f8ebaeae-f51f-4f03-9dff-702a88e478fe service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.404234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-2b2719ef-2277-4d81-8e0d-e5c886afb54e req-f8ebaeae-f51f-4f03-9dff-702a88e478fe service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.405032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-2b2719ef-2277-4d81-8e0d-e5c886afb54e req-f8ebaeae-f51f-4f03-9dff-702a88e478fe service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.416503 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-2b2719ef-2277-4d81-8e0d-e5c886afb54e req-f8ebaeae-f51f-4f03-9dff-702a88e478fe service nova] Creating event network-changed:e5e74a0f-e2bc-43c1-b648-b96bf8f85107 for instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 on hv-cinder-79578 Aug 31 10:59:49.421432 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-2b2719ef-2277-4d81-8e0d-e5c886afb54e req-f8ebaeae-f51f-4f03-9dff-702a88e478fe service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039184 Aug 31 10:59:49.422079 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 430/829] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:49.427307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:49.427907 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:49.434225 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.435060 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.435506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.436205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.436673 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.437082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.455270 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:49.464686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:49.466523 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:49.468438 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-10897948-da7e-42da-bb21-b8030478f33b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1597 microversion: 2.20 time: 0.349076 Aug 31 10:59:49.469071 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 400/830] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 10:59:49 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1597 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 10:59:49.491526 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d1a31775-363d-43c2-b759-bd6c4e2815c2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:49.492054 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d1a31775-363d-43c2-b759-bd6c4e2815c2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:49.499561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1a31775-363d-43c2-b759-bd6c4e2815c2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.500293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1a31775-363d-43c2-b759-bd6c4e2815c2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.500764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1a31775-363d-43c2-b759-bd6c4e2815c2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.501467 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1a31775-363d-43c2-b759-bd6c4e2815c2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.501977 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1a31775-363d-43c2-b759-bd6c4e2815c2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.502374 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1a31775-363d-43c2-b759-bd6c4e2815c2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.520287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] HTTP exception thrown: Instance c6c57211-e6e0-4f67-9029-1806387921e7 is not attached to volume 717902b9-3aef-436a-97cf-9ab12af3f43f Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Request method failure captured: Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: DELETE /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments/717902b9-3aef-436a-97cf-9ab12af3f43f HTTP/1.1 Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz5MM8ccslB3c4fIVPbaZME59iuL2XOs2D_C7jw7y_3jF17vmtbH-bjk7hEhi0xGorWefJ1PUtBjrPVejHj1ulX_zuMMDT-TA-DYJZV5tKfOB4mf9XqIAZ8EeJLx3f5tY57S97wjxTh2IxODNH_c5hB9gMQZ0m2aaF_3QH-tgguSQmg Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 6edee50c9ca84b43b58209073abb6642 Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-TestMinimumBasicScenario-1516731806 Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 10:59:49.536547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_6edee50c9ca84b43b58209073abb6642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/6edee50c9ca84b43b58209073abb6642"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/6edee50c9ca84b43b58209073abb6642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/6edee50c9ca84b43b58209073abb6642"}]}] Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-TestMinimumBasicScenario-1516731806 Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 6edee50c9ca84b43b58209073abb6642 Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1516731806 Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-TestMinimumBasicScenario-1516731806-project Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 1847928c4aa04730a897f38ac67d7071 Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-TestMinimumBasicScenario-1516731806-project Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 10:59:49.538251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance c6c57211-e6e0-4f67-9029-1806387921e7 is not attached to volume 717902b9-3aef-436a-97cf-9ab12af3f43f Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'server_id': 'c6c57211-e6e0-4f67-9029-1806387921e7', 'id': '717902b9-3aef-436a-97cf-9ab12af3f43f'} Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 717902b9-3aef-436a-97cf-9ab12af3f43f. Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:49.539010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c57211-e6e0-4f67-9029-1806387921e7 is not attached to volume 717902b9-3aef-436a-97cf-9ab12af3f43f Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c57211-e6e0-4f67-9029-1806387921e7 is not attached to volume 717902b9-3aef-436a-97cf-9ab12af3f43f Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 10:59:49.540177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Returning 404 to user: Instance c6c57211-e6e0-4f67-9029-1806387921e7 is not attached to volume 717902b9-3aef-436a-97cf-9ab12af3f43f {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:49.541088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d77a614a-d045-4e79-b9f8-cc80393d9521 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments/717902b9-3aef-436a-97cf-9ab12af3f43f" status: 404 len: 154 microversion: 2.1 time: 0.115090 Aug 31 10:59:49.542592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 431/831] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 10:59:49 2022] DELETE /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7/os-volume_attachments/717902b9-3aef-436a-97cf-9ab12af3f43f => generated 154 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:59:49.602330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d1a31775-363d-43c2-b759-bd6c4e2815c2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115250 Aug 31 10:59:49.602944 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 401/832] 10.222.0.75 () {60 vars in 1316 bytes} [Wed Aug 31 10:59:49 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 10:59:49.652984 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:49.653605 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:49.661928 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.662421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.662852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.663616 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:49.664070 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:49.664490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:49.907046 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:49.917025 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-78965590-cb14-4bad-acbd-a96f48199593 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1364 microversion: 2.1 time: 0.270000 Aug 31 10:59:49.923584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 432/833] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:49 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:50.662763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-757069c9-1752-41b0-8cb9-0a902373e027 req-37a0454d-601f-45ab-90a4-c41f592bd1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd1f4b3-b876-4694-879d-791fb851a085", "tag": "13802481-258c-4015-b25a-d35749ab72e3"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:50.679273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-757069c9-1752-41b0-8cb9-0a902373e027 req-37a0454d-601f-45ab-90a4-c41f592bd1d7 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:50.680413 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-757069c9-1752-41b0-8cb9-0a902373e027 req-37a0454d-601f-45ab-90a4-c41f592bd1d7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:50.680860 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-757069c9-1752-41b0-8cb9-0a902373e027 req-37a0454d-601f-45ab-90a4-c41f592bd1d7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:50.695260 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:50.696782 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:50.698137 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-757069c9-1752-41b0-8cb9-0a902373e027 req-37a0454d-601f-45ab-90a4-c41f592bd1d7 service nova] Creating event network-changed:13802481-258c-4015-b25a-d35749ab72e3 for instance 1cd1f4b3-b876-4694-879d-791fb851a085 on hv-cinder-79578 Aug 31 10:59:50.704436 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-757069c9-1752-41b0-8cb9-0a902373e027 req-37a0454d-601f-45ab-90a4-c41f592bd1d7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109306 Aug 31 10:59:50.705531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 402/834] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:50.710262 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:50.711009 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:50.711590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:50.712328 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:50.712787 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:50.713358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:50.740686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 10:59:50.823345 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0952f117-0f97-4a70-a603-8cdc10827f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 204 len: 0 microversion: 2.1 time: 0.132938 Aug 31 10:59:50.824284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 433/835] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 10:59:50 2022] DELETE /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 10:59:50.834241 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:50.835904 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:50.842561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:50.843549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:50.844691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:50.845611 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:50.846317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:50.846942 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:50.939724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:50.941597 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:50.951048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:50.951933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:50.952556 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:50.953553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:50.954250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:50.954879 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:51.229804 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:51.238446 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-38cbcfe2-0025-451d-9f44-00919ed95f47 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1555 microversion: 2.1 time: 0.408881 Aug 31 10:59:51.239026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 403/836] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:50 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1555 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:51.251688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:51.265408 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9de690c2-6b00-4846-beda-8ac0756c731e tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1364 microversion: 2.1 time: 0.331192 Aug 31 10:59:51.266693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 434/837] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:50 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 10:59:52.265728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:52.266354 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:52.268970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=4 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:52.274540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:52.275014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:52.275438 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:52.276126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:52.276552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:52.277171 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:52.286999 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:52.288275 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:52.295165 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:52.295884 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:52.296487 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:52.297347 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:52.298101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:52.298528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:52.501490 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:52.509835 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:52.511561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6845b444-9ccb-491e-8707-71af36938f98 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1555 microversion: 2.1 time: 0.249701 Aug 31 10:59:52.512256 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 404/838] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:52 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1555 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:52.531173 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4857ec46-35f4-480b-8e38-0e004de0bedc tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1364 microversion: 2.1 time: 0.248136 Aug 31 10:59:52.531892 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 435/839] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:52 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:53.533111 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:53.534015 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:53.541478 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:53.542025 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:53.542472 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:53.543195 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:53.543650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:53.544108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:53.552797 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:53.553561 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:53.561098 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:53.561967 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:53.562650 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:53.563527 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:53.564100 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:53.564600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:54.125551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:54.135195 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-fccb96da-eece-477a-8db2-68727e8de517 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1364 microversion: 2.1 time: 0.586306 Aug 31 10:59:54.136070 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 436/840] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:53 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1364 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:54.151499 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:54.167143 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-55af9921-2c97-44fb-aaec-6295446c69b2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1555 microversion: 2.1 time: 0.637233 Aug 31 10:59:54.176972 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 405/841] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:53 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1555 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:54.349890 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-65052c2c-e159-4622-b23b-d106b8b3c4dd req-9f448e26-d179-4ed3-8e33-d3b6df6d63b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175e5c4c-5bf1-44fb-81aa-7268900587c1", "name": "network-vif-plugged", "status": "completed", "tag": "e5e74a0f-e2bc-43c1-b648-b96bf8f85107"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:54.360899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-65052c2c-e159-4622-b23b-d106b8b3c4dd req-9f448e26-d179-4ed3-8e33-d3b6df6d63b7 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:54.361450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-65052c2c-e159-4622-b23b-d106b8b3c4dd req-9f448e26-d179-4ed3-8e33-d3b6df6d63b7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:54.362135 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-65052c2c-e159-4622-b23b-d106b8b3c4dd req-9f448e26-d179-4ed3-8e33-d3b6df6d63b7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:54.377566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-65052c2c-e159-4622-b23b-d106b8b3c4dd req-9f448e26-d179-4ed3-8e33-d3b6df6d63b7 service nova] Creating event network-vif-plugged:e5e74a0f-e2bc-43c1-b648-b96bf8f85107 for instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 on hv-cinder-79578 Aug 31 10:59:54.387616 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-65052c2c-e159-4622-b23b-d106b8b3c4dd req-9f448e26-d179-4ed3-8e33-d3b6df6d63b7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208266 Aug 31 10:59:54.388278 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 437/842] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:54.424809 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-e9111f69-a23b-49d8-a0cd-7d7dacb3b21b req-f9c19a71-8aee-4b2f-a5f9-3048745f595a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c57211-e6e0-4f67-9029-1806387921e7", "name": "network-vif-deleted", "tag": "ad172ad1-ff5a-4d9c-8473-07c7509a5e88"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 10:59:54.435235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-e9111f69-a23b-49d8-a0cd-7d7dacb3b21b req-f9c19a71-8aee-4b2f-a5f9-3048745f595a service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:54.435898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-e9111f69-a23b-49d8-a0cd-7d7dacb3b21b req-f9c19a71-8aee-4b2f-a5f9-3048745f595a service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:54.436327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-e9111f69-a23b-49d8-a0cd-7d7dacb3b21b req-f9c19a71-8aee-4b2f-a5f9-3048745f595a service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:54.449226 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-e9111f69-a23b-49d8-a0cd-7d7dacb3b21b req-f9c19a71-8aee-4b2f-a5f9-3048745f595a service nova] Creating event network-vif-deleted:ad172ad1-ff5a-4d9c-8473-07c7509a5e88 for instance c6c57211-e6e0-4f67-9029-1806387921e7 on hv-cinder-79578 Aug 31 10:59:54.454497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-e9111f69-a23b-49d8-a0cd-7d7dacb3b21b req-f9c19a71-8aee-4b2f-a5f9-3048745f595a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033591 Aug 31 10:59:54.455089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 406/843] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 10:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 10:59:55.156417 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:55.157327 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=8 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:55.162032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:55.162749 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:55.169977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:55.170463 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:55.170900 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:55.171593 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:55.172050 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:55.172478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:55.197172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:55.197706 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:55.198447 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:55.205254 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:55.205734 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:55.206201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:55.206889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:55.207357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:55.207819 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:55.279842 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:55.288183 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2b20c7c7-ecb8-4b6e-b3af-09d5e1ba7556 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1513 microversion: 2.1 time: 0.095226 Aug 31 10:59:55.288865 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 407/844] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:55 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1513 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:55.343598 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:55.351542 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-904fcaa2-e632-42f3-88bc-09b1917dad17 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1364 microversion: 2.1 time: 0.196680 Aug 31 10:59:55.352148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 438/845] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:55 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:56.310307 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:56.310904 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:56.317991 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:56.318478 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:56.318922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:56.319627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:56.320078 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:56.320501 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:56.372474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:56.373785 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:56.380405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:56.381240 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:56.381337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:56.382548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:56.382998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:56.383521 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:56.383821 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:56.392271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d993d088-9887-471b-a281-d3c748f33f4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1513 microversion: 2.1 time: 0.086396 Aug 31 10:59:56.393095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 408/846] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:56 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1513 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:56.523407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:56.532121 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1e05830a-8148-4db2-9e37-9b14390ff7d7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1364 microversion: 2.1 time: 0.163668 Aug 31 10:59:56.532681 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 439/847] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:56 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:57.417863 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:57.418964 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:57.430023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:57.430741 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:57.431181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:57.431872 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:57.432325 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:57.432792 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:57.467316 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:57.467711 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:57.468149 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:57.468589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lazy-loading 'fault' on Instance uuid c6c57211-e6e0-4f67-9029-1806387921e7 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:59:57.510880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:57.518774 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1c6b448f-4c74-4039-b71a-ec7a80fa7e4b tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1348 microversion: 2.1 time: 0.107498 Aug 31 10:59:57.519346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 409/848] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:57 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1348 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:57.552728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:57.553317 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:57.560683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:57.561172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:57.561589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:57.562326 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:57.562780 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:57.563213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:57.697686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:57.706225 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-164c8494-5336-4a69-95fc-67c97b823f82 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1364 microversion: 2.1 time: 0.157363 Aug 31 10:59:57.707683 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 440/849] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:57 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:58.539978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:58.540678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:58.549022 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:58.550006 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:58.550575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:58.551273 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:58.551781 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:58.552251 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:58.588750 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:58.589330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:58.589790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:58.590244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lazy-loading 'fault' on Instance uuid c6c57211-e6e0-4f67-9029-1806387921e7 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 10:59:58.633409 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1847928c4aa04730a897f38ac67d7071', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6edee50c9ca84b43b58209073abb6642', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:58.640858 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9365b499-af61-4987-9269-cd7f780e702f tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 200 len: 1348 microversion: 2.1 time: 0.105309 Aug 31 10:59:58.641452 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 410/850] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:58 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:58.731460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:58.732434 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:58.743761 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:58.744643 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:58.745191 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:58.745931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:58.746379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:58.746805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:58.887089 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 10:59:58.895242 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3738ced7-7b85-4233-8db9-cdd17bce5653 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1364 microversion: 2.1 time: 0.170542 Aug 31 10:59:58.895819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 441/851] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:58 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 10:59:59.662767 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:59.663462 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] [instance: c6c57211-e6e0-4f67-9029-1806387921e7] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:59.670378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:59.670848 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:59.671304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:59.672061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:59.672576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:59.672970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:59.688035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] HTTP exception thrown: Instance c6c57211-e6e0-4f67-9029-1806387921e7 could not be found. Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Request method failure captured: Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 HTTP/1.1 Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz5MM8ccslB3c4fIVPbaZME59iuL2XOs2D_C7jw7y_3jF17vmtbH-bjk7hEhi0xGorWefJ1PUtBjrPVejHj1ulX_zuMMDT-TA-DYJZV5tKfOB4mf9XqIAZ8EeJLx3f5tY57S97wjxTh2IxODNH_c5hB9gMQZ0m2aaF_3QH-tgguSQmg Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 6edee50c9ca84b43b58209073abb6642 Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-TestMinimumBasicScenario-1516731806 Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 10:59:59.689705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_6edee50c9ca84b43b58209073abb6642"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/6edee50c9ca84b43b58209073abb6642"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/6edee50c9ca84b43b58209073abb6642"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/6edee50c9ca84b43b58209073abb6642"}]}] Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-TestMinimumBasicScenario-1516731806 Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 6edee50c9ca84b43b58209073abb6642 Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1516731806 Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-TestMinimumBasicScenario-1516731806-project Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 1847928c4aa04730a897f38ac67d7071 Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-TestMinimumBasicScenario-1516731806-project Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance c6c57211-e6e0-4f67-9029-1806387921e7 could not be found. Aug 31 10:59:59.691411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'c6c57211-e6e0-4f67-9029-1806387921e7'} Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c57211-e6e0-4f67-9029-1806387921e7 could not be found. Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 10:59:59.692433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c57211-e6e0-4f67-9029-1806387921e7 could not be found. Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c57211-e6e0-4f67-9029-1806387921e7 could not be found. Aug 31 10:59:59.693938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 10:59:59.695383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Returning 404 to user: Instance c6c57211-e6e0-4f67-9029-1806387921e7 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 10:59:59.695383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7c6b9fa7-45b9-4b57-9a4d-ebb29ee64cd2 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7" status: 404 len: 111 microversion: 2.1 time: 0.032568 Aug 31 10:59:59.695383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 411/852] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:59 2022] GET /compute/v2.1/servers/c6c57211-e6e0-4f67-9029-1806387921e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 10:59:59.700419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-95705430-d871-404c-9c16-ba3bc5f37616 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] Calling method '.version_select at 0x7f37a8b99160>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:59.723440 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-95705430-d871-404c-9c16-ba3bc5f37616 tempest-TestMinimumBasicScenario-1516731806 tempest-TestMinimumBasicScenario-1516731806-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-793035932" status: 202 len: 0 microversion: 2.1 time: 0.026924 Aug 31 10:59:59.724051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 442/853] 10.222.0.75 () {58 vars in 1269 bytes} [Wed Aug 31 10:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-793035932 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 10:59:59.915387 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 10:59:59.915998 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 10:59:59.922603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:59.923034 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:59.923463 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:59.924164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 10:59:59.924631 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 10:59:59.925070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 10:59:59.941002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:00.065511 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:00.073936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8b004ada-d8f0-460c-9557-716aa4e3ab18 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1550 microversion: 2.1 time: 0.162479 Aug 31 11:00:00.074448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 412/854] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 10:59:59 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:00.094795 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-04a44b24-0e1c-411a-8f2c-d09a091eb6f3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:00.095273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-04a44b24-0e1c-411a-8f2c-d09a091eb6f3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:00.101491 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-04a44b24-0e1c-411a-8f2c-d09a091eb6f3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:00.102020 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-04a44b24-0e1c-411a-8f2c-d09a091eb6f3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:00.102457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-04a44b24-0e1c-411a-8f2c-d09a091eb6f3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:00.103155 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-04a44b24-0e1c-411a-8f2c-d09a091eb6f3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:00.103606 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-04a44b24-0e1c-411a-8f2c-d09a091eb6f3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:00.104028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-04a44b24-0e1c-411a-8f2c-d09a091eb6f3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:00.190817 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-04a44b24-0e1c-411a-8f2c-d09a091eb6f3 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100549 Aug 31 11:00:00.191435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 443/855] 10.222.0.75 () {58 vars in 1275 bytes} [Wed Aug 31 11:00:00 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:00.274052 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ddba3beb-4ec1-4594-84f3-b085dfb3c1ce tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:00.274562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ddba3beb-4ec1-4594-84f3-b085dfb3c1ce tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:00.282004 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ddba3beb-4ec1-4594-84f3-b085dfb3c1ce tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:00.282547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ddba3beb-4ec1-4594-84f3-b085dfb3c1ce tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:00.282975 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ddba3beb-4ec1-4594-84f3-b085dfb3c1ce tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:00.283672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ddba3beb-4ec1-4594-84f3-b085dfb3c1ce tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:00.284117 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ddba3beb-4ec1-4594-84f3-b085dfb3c1ce tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:00.284732 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ddba3beb-4ec1-4594-84f3-b085dfb3c1ce tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:00.308766 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ddba3beb-4ec1-4594-84f3-b085dfb3c1ce tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/ips" status: 200 len: 149 microversion: 2.1 time: 0.158932 Aug 31 11:00:00.316202 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 413/856] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 11:00:00 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/ips => generated 149 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:01.465695 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-a8a05dbc-3e27-419d-9488-9bcadb5e8314 req-635fdf76-2685-4029-a156-8a82e434d7ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "175e5c4c-5bf1-44fb-81aa-7268900587c1", "tag": "e5e74a0f-e2bc-43c1-b648-b96bf8f85107"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:01.476091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-a8a05dbc-3e27-419d-9488-9bcadb5e8314 req-635fdf76-2685-4029-a156-8a82e434d7ae service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:01.476575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-a8a05dbc-3e27-419d-9488-9bcadb5e8314 req-635fdf76-2685-4029-a156-8a82e434d7ae service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:01.477021 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-a8a05dbc-3e27-419d-9488-9bcadb5e8314 req-635fdf76-2685-4029-a156-8a82e434d7ae service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:01.489346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-a8a05dbc-3e27-419d-9488-9bcadb5e8314 req-635fdf76-2685-4029-a156-8a82e434d7ae service nova] Creating event network-changed:e5e74a0f-e2bc-43c1-b648-b96bf8f85107 for instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 on hv-cinder-79578 Aug 31 11:00:01.494323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-a8a05dbc-3e27-419d-9488-9bcadb5e8314 req-635fdf76-2685-4029-a156-8a82e434d7ae service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032369 Aug 31 11:00:01.495493 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 444/857] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:01.717041 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-029168a9-4cdb-40c7-94b4-5ce6e870934a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9a77545-795a-45c6-8166-2ca1b242eb37"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:01.720653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-029168a9-4cdb-40c7-94b4-5ce6e870934a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:01.728720 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-029168a9-4cdb-40c7-94b4-5ce6e870934a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:01.729587 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-029168a9-4cdb-40c7-94b4-5ce6e870934a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:01.730214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-029168a9-4cdb-40c7-94b4-5ce6e870934a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:01.730919 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-029168a9-4cdb-40c7-94b4-5ce6e870934a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:01.731518 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-029168a9-4cdb-40c7-94b4-5ce6e870934a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:01.731938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-029168a9-4cdb-40c7-94b4-5ce6e870934a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:02.218274 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-029168a9-4cdb-40c7-94b4-5ce6e870934a tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504611 Aug 31 11:00:02.220437 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 414/858] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 11:00:01 2022] POST /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:09.835717 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9a77545-795a-45c6-8166-2ca1b242eb37"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:09.839565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:09.841522 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:09.847375 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:09.847834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:09.848285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:09.849436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:09.849436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:09.849832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:09.933942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Invalid volume: volume b9a77545-795a-45c6-8166-2ca1b242eb37 is already attached to instances: cb34b296-2951-4f41-be97-703d0d35dfe4 Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: POST /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments HTTP/1.1 Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 74 Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:00:09.936031 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {"volumeAttachment": {"volumeId": "b9a77545-795a-45c6-8166-2ca1b242eb37"}} Aug 31 11:00:09.937841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Invalid volume: volume b9a77545-795a-45c6-8166-2ca1b242eb37 is already attached to instances: cb34b296-2951-4f41-be97-703d0d35dfe4 Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'server_id': 'cb34b296-2951-4f41-be97-703d0d35dfe4', 'body': {'volumeAttachment': {'volumeId': 'b9a77545-795a-45c6-8166-2ca1b242eb37'}}} Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b9a77545-795a-45c6-8166-2ca1b242eb37 is already attached to instances: cb34b296-2951-4f41-be97-703d0d35dfe4 Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:00:09.938806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b9a77545-795a-45c6-8166-2ca1b242eb37 is already attached to instances: cb34b296-2951-4f41-be97-703d0d35dfe4 Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:09.940259 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:09.941893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:09.941893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:00:09.941893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:00:09.941893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b9a77545-795a-45c6-8166-2ca1b242eb37 is already attached to instances: cb34b296-2951-4f41-be97-703d0d35dfe4 Aug 31 11:00:09.941893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:00:09.941893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 400 to user: Invalid volume: volume b9a77545-795a-45c6-8166-2ca1b242eb37 is already attached to instances: cb34b296-2951-4f41-be97-703d0d35dfe4 {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:00:09.941893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a0d24c08-5078-4c72-9604-2506b368e24e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108002 Aug 31 11:00:09.941893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 445/859] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 11:00:09 2022] POST /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:00:10.003496 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:10.004088 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:10.011693 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:10.012177 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:10.012614 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:10.013279 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:10.013732 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:10.014190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:10.097396 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lazy-loading 'services' on Instance uuid cb34b296-2951-4f41-be97-703d0d35dfe4 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:00:10.181746 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-089e8251-8ed0-4638-9d61-628176464bf1 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments/b9a77545-795a-45c6-8166-2ca1b242eb37" status: 202 len: 0 microversion: 2.1 time: 0.182525 Aug 31 11:00:10.182384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 415/860] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 11:00:09 2022] DELETE /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments/b9a77545-795a-45c6-8166-2ca1b242eb37 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:00:10.191594 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-72492a66-efa4-480e-8379-af3312aba61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:10.193993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-72492a66-efa4-480e-8379-af3312aba61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:10.200436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72492a66-efa4-480e-8379-af3312aba61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:10.201000 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72492a66-efa4-480e-8379-af3312aba61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:10.201456 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72492a66-efa4-480e-8379-af3312aba61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:10.202197 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72492a66-efa4-480e-8379-af3312aba61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:10.202652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72492a66-efa4-480e-8379-af3312aba61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:10.203109 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72492a66-efa4-480e-8379-af3312aba61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:10.238638 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-72492a66-efa4-480e-8379-af3312aba61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051081 Aug 31 11:00:10.239301 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 446/861] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:00:10 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:11.256641 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9862dbdf-3c83-419b-8511-958ac7cf4691 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:11.260462 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9862dbdf-3c83-419b-8511-958ac7cf4691 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:11.271315 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9862dbdf-3c83-419b-8511-958ac7cf4691 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:11.272106 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9862dbdf-3c83-419b-8511-958ac7cf4691 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:11.272821 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9862dbdf-3c83-419b-8511-958ac7cf4691 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:11.273982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9862dbdf-3c83-419b-8511-958ac7cf4691 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:11.274726 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9862dbdf-3c83-419b-8511-958ac7cf4691 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:11.275418 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9862dbdf-3c83-419b-8511-958ac7cf4691 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:11.305619 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9862dbdf-3c83-419b-8511-958ac7cf4691 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057251 Aug 31 11:00:11.306285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 416/862] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:00:11 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:00:11.371734 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:11.372277 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:11.379072 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:11.379554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:11.379983 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:11.380677 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:11.381125 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:11.381543 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:11.406947 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:00:11.486257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-62b035f2-d66b-43f3-adf2-2389980e1367 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 204 len: 0 microversion: 2.1 time: 0.118043 Aug 31 11:00:11.486814 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 447/863] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:00:11 2022] DELETE /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:00:11.495204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:11.495825 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:11.502222 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:11.502778 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:11.503305 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:11.504010 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:11.504469 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:11.504897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:11.647564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:11.656165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2e2a4029-c995-41c1-a1e8-77fb7b891b87 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1680 microversion: 2.1 time: 0.164898 Aug 31 11:00:11.656744 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 417/864] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:11 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:12.683048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:12.684239 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:12.691809 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:12.692310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:12.692751 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:12.693447 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:12.693951 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:12.694374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:12.832762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:12.841756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d86bf096-4c60-4b1e-934a-c44c3185bc41 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1680 microversion: 2.1 time: 0.166221 Aug 31 11:00:12.842361 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 448/865] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:12 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:13.864117 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:13.864870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:13.868114 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:13.873596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:13.874109 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:13.874544 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:13.875247 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:13.875701 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:13.876122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:14.085327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:14.093583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-043aa98b-0092-4d53-b296-a33c143fe9c8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1680 microversion: 2.1 time: 0.233370 Aug 31 11:00:14.094235 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 418/866] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:13 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:14.288950 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:14.289528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:14.300633 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:14.301219 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:14.301669 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:14.302408 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:14.302866 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:14.303301 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:14.387027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lazy-loading 'services' on Instance uuid 80088fbb-9cea-4ee2-8224-ec783c4f9397 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:00:14.461142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-e3df47c0-cce5-4ff8-90ca-8420a7b1cae1 req-892c9722-2f76-4f10-94a3-6f8731764d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb34b296-2951-4f41-be97-703d0d35dfe4", "name": "network-vif-deleted", "tag": "df151cfd-29a8-42f3-9cd6-315c1ca177f3"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:14.472142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-e3df47c0-cce5-4ff8-90ca-8420a7b1cae1 req-892c9722-2f76-4f10-94a3-6f8731764d53 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:14.478203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-e3df47c0-cce5-4ff8-90ca-8420a7b1cae1 req-892c9722-2f76-4f10-94a3-6f8731764d53 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:14.482204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-e3df47c0-cce5-4ff8-90ca-8420a7b1cae1 req-892c9722-2f76-4f10-94a3-6f8731764d53 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:14.496297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-e3df47c0-cce5-4ff8-90ca-8420a7b1cae1 req-892c9722-2f76-4f10-94a3-6f8731764d53 service nova] Creating event network-vif-deleted:df151cfd-29a8-42f3-9cd6-315c1ca177f3 for instance cb34b296-2951-4f41-be97-703d0d35dfe4 on hv-cinder-79578 Aug 31 11:00:14.497638 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5f6b4aee-3e5a-4723-8e6f-796aef4739c3 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "DELETE /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments/a08717e2-b9f6-48d4-be09-5454f716fbe2" status: 202 len: 0 microversion: 2.1 time: 0.211561 Aug 31 11:00:14.499061 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 449/867] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 11:00:14 2022] DELETE /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments/a08717e2-b9f6-48d4-be09-5454f716fbe2 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:00:14.502224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-e3df47c0-cce5-4ff8-90ca-8420a7b1cae1 req-892c9722-2f76-4f10-94a3-6f8731764d53 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044850 Aug 31 11:00:14.503215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 419/868] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:00:14.511487 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7a6e6421-ebb8-42c9-93a3-341aeafa199e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:14.515047 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7a6e6421-ebb8-42c9-93a3-341aeafa199e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:14.523232 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a6e6421-ebb8-42c9-93a3-341aeafa199e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:14.530709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a6e6421-ebb8-42c9-93a3-341aeafa199e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:14.531505 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a6e6421-ebb8-42c9-93a3-341aeafa199e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:14.532368 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a6e6421-ebb8-42c9-93a3-341aeafa199e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:14.532843 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a6e6421-ebb8-42c9-93a3-341aeafa199e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:14.533277 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7a6e6421-ebb8-42c9-93a3-341aeafa199e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:14.568607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7a6e6421-ebb8-42c9-93a3-341aeafa199e tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062723 Aug 31 11:00:14.569559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 450/869] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:00:14 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:15.117280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:15.118671 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:15.126042 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:15.126551 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:15.126978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:15.127699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:15.128156 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:15.128617 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:15.179099 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:15.179649 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:15.180084 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:15.180533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lazy-loading 'fault' on Instance uuid cb34b296-2951-4f41-be97-703d0d35dfe4 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:00:15.230580 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:15.238615 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1caa8b93-50e3-4637-aeef-d98169ba2625 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 200 len: 1330 microversion: 2.1 time: 0.126649 Aug 31 11:00:15.239184 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 420/870] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:15 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 1330 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:15.581431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ee502d39-360c-425a-b59c-83ef22109834 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:15.583859 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ee502d39-360c-425a-b59c-83ef22109834 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:15.590517 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee502d39-360c-425a-b59c-83ef22109834 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:15.591146 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee502d39-360c-425a-b59c-83ef22109834 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:15.591655 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee502d39-360c-425a-b59c-83ef22109834 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:15.592435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee502d39-360c-425a-b59c-83ef22109834 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:15.592962 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee502d39-360c-425a-b59c-83ef22109834 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:15.593512 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ee502d39-360c-425a-b59c-83ef22109834 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:15.623204 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ee502d39-360c-425a-b59c-83ef22109834 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045988 Aug 31 11:00:15.623737 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 451/871] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:00:15 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:00:15.710463 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:15.711063 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:15.717320 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:15.717831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:15.718265 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:15.718953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:15.719405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:15.719825 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:15.746472 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:00:15.830530 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4d882fe6-9135-4d22-b65a-b8f1ff336279 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "DELETE /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 204 len: 0 microversion: 2.1 time: 0.123791 Aug 31 11:00:15.831117 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 421/872] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:00:15 2022] DELETE /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:00:15.839868 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:15.840557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:15.846779 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:15.847270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:15.847699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:15.848396 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:15.849164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:15.849272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:15.990994 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:15.999561 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b7128ba6-ddd5-4657-9bc0-86189ea1e561 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1689 microversion: 2.1 time: 0.163921 Aug 31 11:00:16.000135 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 452/873] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:15 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:16.263090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:16.264735 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:16.271803 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:16.272301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:16.272735 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:16.273441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:16.273930 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:16.274360 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:16.288842 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 HTTP/1.1 Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:00:16.290519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:00:16.292021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'cb34b296-2951-4f41-be97-703d0d35dfe4'} Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:00:16.292790 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:00:16.294261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:16.295603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:00:16.295603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1f0f6773-67b4-44ad-9fac-fea0c5797e2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 404 len: 111 microversion: 2.1 time: 0.035449 Aug 31 11:00:16.295603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 422/874] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:16 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:00:16.304403 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ae37650c-b619-4fcb-9204-c8cab9d17270 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '.version_select at 0x7f37a8c21e50>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:16.330855 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ae37650c-b619-4fcb-9204-c8cab9d17270 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52457514" status: 202 len: 0 microversion: 2.1 time: 0.032869 Aug 31 11:00:16.331445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 453/875] 10.222.0.75 () {58 vars in 1215 bytes} [Wed Aug 31 11:00:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52457514 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:00:16.976358 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-386d8b17-bf9f-499c-964c-72dff8a3a61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: .version_select at 0x7f37a8d78820>, body: {"keypair": {"name": "tempest-keypair-1795349576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyt30w2imlcsensGIeOGAwqeIekuP1FR3NY1VeRkp0uQqzOGMcm5g7SVAS2kfBGmnZKjJrlcyocdLUOsncAM1b3CyTlVKaiqppw/2oGirj0MBcnzMbxeohn7qsz970j6g=="}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:16.992330 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-386d8b17-bf9f-499c-964c-72dff8a3a61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:00:16.996470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-386d8b17-bf9f-499c-964c-72dff8a3a61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for user 73f1b9e32ad3493284c5df45afd042fa and project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:00:17.023411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:17.024281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-386d8b17-bf9f-499c-964c-72dff8a3a61c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051818 Aug 31 11:00:17.024627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:17.024888 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 423/876] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 11:00:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:17.032159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:17.032656 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:17.033212 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:17.033954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:17.034407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:17.034833 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:17.172165 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:17.181735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a38ba985-cea1-4870-a8cc-1d8e41ba4f4b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1689 microversion: 2.1 time: 0.163891 Aug 31 11:00:17.186257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 454/877] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:17 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:18.203838 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:18.204538 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:18.212438 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:18.212924 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:18.213355 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:18.214328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:18.214630 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:18.215028 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:18.367069 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:18.375500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ae1d6cfc-0c42-4c04-96c8-1e67f7087f4c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1689 microversion: 2.1 time: 0.175715 Aug 31 11:00:18.376061 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 424/878] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:18 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:18.395328 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-796505042", "imageRef": "520e8f4f-a8b3-438c-aab0-67ac25a69a39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea0de259-9ec9-40ad-9450-e7dd0067411a"}], "security_groups": [{"name": "tempest-securitygroup--1934337178"}], "key_name": "tempest-keypair-1795349576", "user_data": "}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:18.512979 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] validate_networks() for [('ea0de259-9ec9-40ad-9450-e7dd0067411a', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:00:19.191343 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:00:19.192067 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:00:19.192908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:00:19.193581 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:00:19.194348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:00:19.206073 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:19.206758 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:19.207367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:19.208088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:19.208535 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:19.208951 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:19.225566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:00:19.229881 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Getting quotas for user 73f1b9e32ad3493284c5df45afd042fa and project 7c3039f002ef448b99d4e7f484055fd7. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:00:19.241226 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:00:19.243761 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='520e8f4f-a8b3-438c-aab0-67ac25a69a39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:00:19.297841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b067d681-f7ad-4eb6-a996-55bfad5416c0 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.906900 Aug 31 11:00:19.298507 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 455/879] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 11:00:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:00:19.309575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-efb7cdf0-5638-42e8-98a3-331ad450ab2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:19.310545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-efb7cdf0-5638-42e8-98a3-331ad450ab2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:19.365044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-efb7cdf0-5638-42e8-98a3-331ad450ab2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:19.371965 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-efb7cdf0-5638-42e8-98a3-331ad450ab2e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1241 microversion: 2.1 time: 0.066323 Aug 31 11:00:19.372538 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 425/880] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:19 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:19.396797 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:19.397474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:19.406815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:19.407304 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:19.407780 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:19.408510 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:19.408957 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:19.409544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:19.428160 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:19.553958 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:19.563345 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b76286b4-e95a-4781-a261-fae80bc92995 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1689 microversion: 2.1 time: 0.170526 Aug 31 11:00:19.564112 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 456/881] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:19 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:20.393173 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:20.393855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:20.401352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:20.401860 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:20.402285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:20.402982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:20.403431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:20.403851 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:20.503980 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:20.524142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a9a3a27c-7c8a-4d94-88b8-e5ecbfbfb930 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1293 microversion: 2.1 time: 0.134837 Aug 31 11:00:20.524810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 426/882] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:20 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:20.585036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:20.585811 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:20.593552 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:20.594420 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:20.595496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:20.596255 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:20.596719 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:20.597361 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:20.720120 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:20.729978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-46a67279-4130-4fb8-a896-e11b1da22d7c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1622 microversion: 2.1 time: 0.148288 Aug 31 11:00:20.730650 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 457/883] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:20 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1622 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:21.168630 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-28fbc85f-fa84-44e4-bf4c-692df709bc4a req-d5fe7ad0-0fbe-4ba4-ba59-696bf04d72ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80088fbb-9cea-4ee2-8224-ec783c4f9397", "name": "network-vif-deleted", "tag": "64257485-56f5-4b89-a0a9-09ac5a18b844"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:21.183881 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-28fbc85f-fa84-44e4-bf4c-692df709bc4a req-d5fe7ad0-0fbe-4ba4-ba59-696bf04d72ff service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:21.184912 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-28fbc85f-fa84-44e4-bf4c-692df709bc4a req-d5fe7ad0-0fbe-4ba4-ba59-696bf04d72ff service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:21.185999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-28fbc85f-fa84-44e4-bf4c-692df709bc4a req-d5fe7ad0-0fbe-4ba4-ba59-696bf04d72ff service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:21.199010 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-28fbc85f-fa84-44e4-bf4c-692df709bc4a req-d5fe7ad0-0fbe-4ba4-ba59-696bf04d72ff service nova] Creating event network-vif-deleted:64257485-56f5-4b89-a0a9-09ac5a18b844 for instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 on hv-cinder-79578 Aug 31 11:00:21.204597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-28fbc85f-fa84-44e4-bf4c-692df709bc4a req-d5fe7ad0-0fbe-4ba4-ba59-696bf04d72ff service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042393 Aug 31 11:00:21.205997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 427/884] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:21.545805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:21.546450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:21.552647 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:21.553106 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:21.553789 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:21.554274 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:21.554730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:21.555375 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:21.644134 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:21.652593 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8114b440-b067-44c3-9cd3-386d161970d8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1299 microversion: 2.1 time: 0.110679 Aug 31 11:00:21.653470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 458/885] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:21 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:21.752960 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:21.753537 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:21.759944 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:21.760415 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:21.760847 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:21.761543 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:21.762292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:21.762780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:21.800594 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:21.801401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:21.801491 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:21.801945 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lazy-loading 'fault' on Instance uuid 80088fbb-9cea-4ee2-8224-ec783c4f9397 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:00:21.861433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:21.871866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7a6cb53d-8639-4da6-a1d6-8306f3649006 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 200 len: 1336 microversion: 2.1 time: 0.123922 Aug 31 11:00:21.872569 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 428/886] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:21 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:22.674269 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:22.674930 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:22.682810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:22.683315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:22.683744 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:22.684649 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:22.685614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:22.686264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:22.893234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:22.893990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 80088fbb-9cea-4ee2-8224-ec783c4f9397] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:22.900985 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:22.901485 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:22.901950 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:22.902661 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:22.903134 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:22.903554 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:22.908508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:22.913423 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:22.920441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] HTTP exception thrown: Instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 could not be found. Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Request method failure captured: Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 HTTP/1.1 Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3bhecCROhg559l7k6U_enr0Hvh6lIA1bfD95Tam4VIDiIqYdoF7oCrVXCp1BhUt7gilM4vhdttkgI6BDDijC2mGNO8tfaQKHCjF2ZAj7_4FatiqrT1SoMiu_Q_DToTM8iektlE4E5SlylP897K-u16pRUV6d9X0fVtAb0wcS_Wql0 Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:00:22.922737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3aabb02cf14541f997b08fe0853acac0"}]}] Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 3dc4ac4ada004bbb942c36755f4a7cd1 Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 could not be found. Aug 31 11:00:22.925680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '80088fbb-9cea-4ee2-8224-ec783c4f9397'} Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 could not be found. Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:00:22.926620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 could not be found. Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 could not be found. Aug 31 11:00:22.928026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:22.929609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-fe6fa67c-02d2-44a1-8359-352f3861389b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1367 microversion: 2.1 time: 0.252714 Aug 31 11:00:22.929712 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Returning 404 to user: Instance 80088fbb-9cea-4ee2-8224-ec783c4f9397 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:00:22.929837 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 459/887] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:22 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:22.929951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9bc00691-9b92-413c-affb-2206ab78c25d tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397" status: 404 len: 111 microversion: 2.1 time: 0.035326 Aug 31 11:00:22.929951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 429/888] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:22 2022] GET /compute/v2.1/servers/80088fbb-9cea-4ee2-8224-ec783c4f9397 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:00:22.934268 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e0226449-f60d-48c0-8a0f-a4cdfc4597b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '.version_select at 0x7f37a8b991f0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:22.955160 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e0226449-f60d-48c0-8a0f-a4cdfc4597b6 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930968349" status: 202 len: 0 microversion: 2.1 time: 0.024534 Aug 31 11:00:22.955753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 460/889] 10.222.0.75 () {58 vars in 1221 bytes} [Wed Aug 31 11:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1930968349 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:00:23.221065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-c5499d36-7134-4c57-a29c-6c252b090b79 req-702cf88a-ffe1-4257-b232-58dc0449cb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8003d4a4-75b0-44a7-a188-8048bffe8f07", "tag": "d56b8227-5700-4106-8ac8-377944ae1f75"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:23.231212 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-c5499d36-7134-4c57-a29c-6c252b090b79 req-702cf88a-ffe1-4257-b232-58dc0449cb49 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:23.231701 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-c5499d36-7134-4c57-a29c-6c252b090b79 req-702cf88a-ffe1-4257-b232-58dc0449cb49 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:23.235169 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-c5499d36-7134-4c57-a29c-6c252b090b79 req-702cf88a-ffe1-4257-b232-58dc0449cb49 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:23.244044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-c5499d36-7134-4c57-a29c-6c252b090b79 req-702cf88a-ffe1-4257-b232-58dc0449cb49 service nova] Creating event network-changed:d56b8227-5700-4106-8ac8-377944ae1f75 for instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 on hv-cinder-79578 Aug 31 11:00:23.249204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-c5499d36-7134-4c57-a29c-6c252b090b79 req-702cf88a-ffe1-4257-b232-58dc0449cb49 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033225 Aug 31 11:00:23.250142 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 430/890] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:23.945640 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:23.946762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:23.954523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:23.955042 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:23.955457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:23.956163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:23.956748 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:23.957123 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:24.091494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:24.100025 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-89e76722-25a2-4c38-ba6f-209f4eca1f5c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1367 microversion: 2.1 time: 0.159039 Aug 31 11:00:24.100615 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 461/891] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:23 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:25.122100 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:25.122793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:25.130293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:25.130769 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:25.131192 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:25.131877 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:25.132318 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:25.132731 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:25.272867 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:25.281561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-039ee175-6575-4f1c-99cd-892189d9386f tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1367 microversion: 2.1 time: 0.163863 Aug 31 11:00:25.282166 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 431/892] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:25 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:25.900815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:25.901362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:25.908388 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:25.908880 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:25.909320 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:25.910069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:25.910530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:25.910960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:25.937365 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:00:26.030120 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-be19b0b2-7598-478e-a80c-14a115ebe74b tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 204 len: 0 microversion: 2.1 time: 0.132979 Aug 31 11:00:26.030800 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 462/893] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:00:25 2022] DELETE /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:00:26.039431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:26.040058 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:26.046419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:26.046901 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:26.047483 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:26.048177 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:26.048711 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:26.049132 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:26.183970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:26.192576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2268dbf9-199a-47e2-9a3a-1de15984511f tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1507 microversion: 2.1 time: 0.157187 Aug 31 11:00:26.193126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 432/894] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:26 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:00:26.303311 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:26.304134 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:26.310583 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:26.311124 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:26.311625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:26.312433 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:26.312870 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:26.313290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:26.452272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:26.460099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d7686c6c-1aba-4706-b1d1-091e07168e17 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1367 microversion: 2.1 time: 0.161250 Aug 31 11:00:26.460666 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 463/895] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:26 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:27.214026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:27.214853 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:27.222876 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:27.223448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:27.223961 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:27.224777 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:27.225311 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:27.225875 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:27.369806 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:27.377880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1db46521-3c1a-453c-a6b6-a1bbc23a2277 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1507 microversion: 2.1 time: 0.168655 Aug 31 11:00:27.378432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 433/896] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:27 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:27.480970 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:27.481551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:27.488564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:27.489063 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:27.489502 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:27.491399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:27.491399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:27.491399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:28.002217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:28.010681 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5af9d581-2a76-459a-afb6-0d2e8568b639 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1367 microversion: 2.1 time: 0.533769 Aug 31 11:00:28.011326 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 464/897] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:27 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1367 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:28.304727 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-190659c1-f7cb-4702-b5cf-f391e62e0b62 req-4bbf8a0d-6e74-4246-81e4-dba270b305e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2066e84d-41e5-4702-afe4-ebc89f6bab0b", "name": "network-vif-deleted", "tag": "77f10698-fbac-43ca-b9d7-5b0670a8fc2b"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:28.316971 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-190659c1-f7cb-4702-b5cf-f391e62e0b62 req-4bbf8a0d-6e74-4246-81e4-dba270b305e8 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:28.317627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-190659c1-f7cb-4702-b5cf-f391e62e0b62 req-4bbf8a0d-6e74-4246-81e4-dba270b305e8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:28.318089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-190659c1-f7cb-4702-b5cf-f391e62e0b62 req-4bbf8a0d-6e74-4246-81e4-dba270b305e8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:28.330427 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-190659c1-f7cb-4702-b5cf-f391e62e0b62 req-4bbf8a0d-6e74-4246-81e4-dba270b305e8 service nova] Creating event network-vif-deleted:77f10698-fbac-43ca-b9d7-5b0670a8fc2b for instance 2066e84d-41e5-4702-afe4-ebc89f6bab0b on hv-cinder-79578 Aug 31 11:00:28.335624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-190659c1-f7cb-4702-b5cf-f391e62e0b62 req-4bbf8a0d-6e74-4246-81e4-dba270b305e8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034507 Aug 31 11:00:28.336221 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 434/898] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:28.398910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:28.399565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:28.406632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:28.407268 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:28.407828 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:28.409279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:28.410210 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:28.410747 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:28.449060 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:28.450498 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:28.451241 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:28.451876 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lazy-loading 'fault' on Instance uuid 2066e84d-41e5-4702-afe4-ebc89f6bab0b {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:00:28.500379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:28.501613 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-7e8dcfff-e59a-401e-8dbe-fff479913802 req-5cc71473-973d-446b-b79b-d6dd1bd3d8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8003d4a4-75b0-44a7-a188-8048bffe8f07", "name": "network-vif-plugged", "status": "completed", "tag": "d56b8227-5700-4106-8ac8-377944ae1f75"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:28.510581 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-051743ad-c3e1-4b7f-9930-4a9b7546dde0 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 200 len: 1312 microversion: 2.1 time: 0.115826 Aug 31 11:00:28.511205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 465/899] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:28 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:28.513716 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-7e8dcfff-e59a-401e-8dbe-fff479913802 req-5cc71473-973d-446b-b79b-d6dd1bd3d8fe service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:28.514455 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-7e8dcfff-e59a-401e-8dbe-fff479913802 req-5cc71473-973d-446b-b79b-d6dd1bd3d8fe service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:28.515160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-7e8dcfff-e59a-401e-8dbe-fff479913802 req-5cc71473-973d-446b-b79b-d6dd1bd3d8fe service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:28.533428 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-7e8dcfff-e59a-401e-8dbe-fff479913802 req-5cc71473-973d-446b-b79b-d6dd1bd3d8fe service nova] Creating event network-vif-plugged:d56b8227-5700-4106-8ac8-377944ae1f75 for instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 on hv-cinder-79578 Aug 31 11:00:28.538630 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-7e8dcfff-e59a-401e-8dbe-fff479913802 req-5cc71473-973d-446b-b79b-d6dd1bd3d8fe service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043090 Aug 31 11:00:28.539751 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 435/900] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:00:29.032032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:29.032950 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:29.039715 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:29.040208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:29.040646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:29.041353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:29.041863 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:29.042293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:29.176208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:29.184585 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-55190657-82d5-440e-bf1b-67cb6391cb26 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1367 microversion: 2.1 time: 0.157413 Aug 31 11:00:29.185507 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 466/901] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:29 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:29.533435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=6 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:29.540765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:29.541995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: 2066e84d-41e5-4702-afe4-ebc89f6bab0b] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:29.550799 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:29.551280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:29.551706 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:29.552388 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:29.552831 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:29.553246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:29.566968 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] HTTP exception thrown: Instance 2066e84d-41e5-4702-afe4-ebc89f6bab0b could not be found. Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Request method failure captured: Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b HTTP/1.1 Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3bhecCROhg559l7k6U_enr0Hvh6lIA1bfD95Tam4VIDiIqYdoF7oCrVXCp1BhUt7gilM4vhdttkgI6BDDijC2mGNO8tfaQKHCjF2ZAj7_4FatiqrT1SoMiu_Q_DToTM8iektlE4E5SlylP897K-u16pRUV6d9X0fVtAb0wcS_Wql0 Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:00:29.568548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3aabb02cf14541f997b08fe0853acac0"}]}] Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 3dc4ac4ada004bbb942c36755f4a7cd1 Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 2066e84d-41e5-4702-afe4-ebc89f6bab0b could not be found. Aug 31 11:00:29.570186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '2066e84d-41e5-4702-afe4-ebc89f6bab0b'} Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2066e84d-41e5-4702-afe4-ebc89f6bab0b could not be found. Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:00:29.571082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2066e84d-41e5-4702-afe4-ebc89f6bab0b could not be found. Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2066e84d-41e5-4702-afe4-ebc89f6bab0b could not be found. Aug 31 11:00:29.572552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:29.573967 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Returning 404 to user: Instance 2066e84d-41e5-4702-afe4-ebc89f6bab0b could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:00:29.573967 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-83c35a7a-07eb-4c85-b20d-22c722cb5874 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b" status: 404 len: 111 microversion: 2.1 time: 0.039049 Aug 31 11:00:29.573967 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 436/902] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:29 2022] GET /compute/v2.1/servers/2066e84d-41e5-4702-afe4-ebc89f6bab0b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:00:29.579413 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:29.579905 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:29.581898 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:29.582558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=6 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:29.589434 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:29.589951 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:29.590387 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:29.591078 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:29.591530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:29.591950 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:29.617877 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:00:29.704625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-40b94b11-5e09-4b97-a5a5-84c19be0df02 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "DELETE /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 204 len: 0 microversion: 2.1 time: 0.128958 Aug 31 11:00:29.705389 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 467/903] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:00:29 2022] DELETE /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:00:29.713677 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:29.714325 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:29.721064 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:29.721558 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:29.722047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:29.722786 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:29.723233 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:29.723651 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:29.861733 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:29.869577 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-623af1d2-8741-4ffb-a5d7-dcc493cd5123 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.159889 Aug 31 11:00:29.870183 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 437/904] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:29 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:30.211691 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:30.212908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:30.223273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:30.224108 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:30.224874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:30.226124 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:30.227567 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:30.227567 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:30.378237 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:30.389469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-590218bd-67fb-401c-903b-4170b8736227 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1367 microversion: 2.1 time: 0.184903 Aug 31 11:00:30.390319 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 468/905] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:30 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:30.893231 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:30.893855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:30.900634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:30.901135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:30.901591 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:30.902316 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:30.902761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:30.903333 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:31.034129 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:31.042562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-31f03518-e4d1-4ccd-8b7c-a53cd11fc12c tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.154575 Aug 31 11:00:31.043116 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 438/906] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:30 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:31.411162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:31.411757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:31.418615 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:31.419103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:31.419535 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:31.420250 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:31.420681 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:31.421087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:31.559583 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:31.572001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3c78a880-044c-4cc6-aab9-df59830f4e51 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1367 microversion: 2.1 time: 0.164604 Aug 31 11:00:31.572710 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 469/907] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:31 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:32.064556 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:32.065187 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:32.072081 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:32.072568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:32.072983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:32.073680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:32.074169 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:32.074592 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:32.209569 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:32.219257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c0e0dd8e-045e-4b1a-827d-f619dfd7b217 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1520 microversion: 2.1 time: 0.159105 Aug 31 11:00:32.219859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 439/908] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:32 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:32.597091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:32.598117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:32.609056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:32.609908 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:32.610637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:32.611531 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:32.611980 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:32.612405 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:32.632944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:32.786416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:32.794865 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2a5dadb8-7678-4ebd-82d5-aaa1fffca137 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1557 microversion: 2.1 time: 0.204361 Aug 31 11:00:32.795495 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 470/909] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:32 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1557 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:32.819154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-43d347cf-bf16-4a81-be7f-d2fdcc52eb67 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:32.819645 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-43d347cf-bf16-4a81-be7f-d2fdcc52eb67 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:32.825933 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-43d347cf-bf16-4a81-be7f-d2fdcc52eb67 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:32.829964 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-43d347cf-bf16-4a81-be7f-d2fdcc52eb67 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:32.829964 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-43d347cf-bf16-4a81-be7f-d2fdcc52eb67 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:32.829964 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-43d347cf-bf16-4a81-be7f-d2fdcc52eb67 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:32.829964 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-43d347cf-bf16-4a81-be7f-d2fdcc52eb67 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:32.830399 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-43d347cf-bf16-4a81-be7f-d2fdcc52eb67 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:32.946981 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-43d347cf-bf16-4a81-be7f-d2fdcc52eb67 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131759 Aug 31 11:00:32.947820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 440/910] 10.222.0.75 () {58 vars in 1275 bytes} [Wed Aug 31 11:00:32 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:33.247720 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:33.250191 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:33.261866 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:33.262701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:33.263543 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:33.264713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:33.265071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:33.265752 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:33.310641 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-fb28097c-9d33-49af-895f-0b17fa28043c req-8ab17a82-cf86-48a7-922f-fdaf9eb2af15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb885a17-8f70-412f-9319-6f48380cdeac", "name": "network-vif-deleted", "tag": "695c308d-47b9-493b-9e2c-0c2ce77ab76b"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:33.325083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-fb28097c-9d33-49af-895f-0b17fa28043c req-8ab17a82-cf86-48a7-922f-fdaf9eb2af15 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:33.326177 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-fb28097c-9d33-49af-895f-0b17fa28043c req-8ab17a82-cf86-48a7-922f-fdaf9eb2af15 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:33.326686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-fb28097c-9d33-49af-895f-0b17fa28043c req-8ab17a82-cf86-48a7-922f-fdaf9eb2af15 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:33.345308 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-fb28097c-9d33-49af-895f-0b17fa28043c req-8ab17a82-cf86-48a7-922f-fdaf9eb2af15 service nova] Creating event network-vif-deleted:695c308d-47b9-493b-9e2c-0c2ce77ab76b for instance bb885a17-8f70-412f-9319-6f48380cdeac on hv-cinder-79578 Aug 31 11:00:33.351688 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-fb28097c-9d33-49af-895f-0b17fa28043c req-8ab17a82-cf86-48a7-922f-fdaf9eb2af15 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048761 Aug 31 11:00:33.352908 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 441/911] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:33.369465 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc4ac4ada004bbb942c36755f4a7cd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aabb02cf14541f997b08fe0853acac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:33.378249 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e0922eaa-da1d-4c5c-9817-8640c4b0bc45 tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 200 len: 1478 microversion: 2.1 time: 0.141388 Aug 31 11:00:33.382866 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 471/912] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:33 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 1478 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:00:33.933039 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-61de219a-ab6d-4977-a039-10eca28fda35 req-51b204cb-5019-4b32-891d-e6f48caeb09f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8003d4a4-75b0-44a7-a188-8048bffe8f07", "tag": "d56b8227-5700-4106-8ac8-377944ae1f75"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:33.943905 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-61de219a-ab6d-4977-a039-10eca28fda35 req-51b204cb-5019-4b32-891d-e6f48caeb09f service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:33.944509 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-61de219a-ab6d-4977-a039-10eca28fda35 req-51b204cb-5019-4b32-891d-e6f48caeb09f service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:33.945050 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-61de219a-ab6d-4977-a039-10eca28fda35 req-51b204cb-5019-4b32-891d-e6f48caeb09f service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:33.957717 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-61de219a-ab6d-4977-a039-10eca28fda35 req-51b204cb-5019-4b32-891d-e6f48caeb09f service nova] Creating event network-changed:d56b8227-5700-4106-8ac8-377944ae1f75 for instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 on hv-cinder-79578 Aug 31 11:00:33.963490 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-61de219a-ab6d-4977-a039-10eca28fda35 req-51b204cb-5019-4b32-891d-e6f48caeb09f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034434 Aug 31 11:00:33.964643 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 442/913] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:34.052718 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cbabb137-00ba-4ac4-9bbf-c58fded73d2e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:34.053366 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cbabb137-00ba-4ac4-9bbf-c58fded73d2e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:34.060772 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbabb137-00ba-4ac4-9bbf-c58fded73d2e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:34.061377 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbabb137-00ba-4ac4-9bbf-c58fded73d2e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:34.062071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbabb137-00ba-4ac4-9bbf-c58fded73d2e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:34.063040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbabb137-00ba-4ac4-9bbf-c58fded73d2e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:34.063596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbabb137-00ba-4ac4-9bbf-c58fded73d2e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:34.064416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cbabb137-00ba-4ac4-9bbf-c58fded73d2e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:34.091399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cbabb137-00ba-4ac4-9bbf-c58fded73d2e tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/ips" status: 200 len: 151 microversion: 2.20 time: 0.046513 Aug 31 11:00:34.097965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 472/914] 10.222.0.75 () {60 vars in 1289 bytes} [Wed Aug 31 11:00:34 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:00:34.405190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:34.406759 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] [instance: bb885a17-8f70-412f-9319-6f48380cdeac] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:34.424792 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:34.426198 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:34.427124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:34.427993 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:34.429362 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:34.430159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:34.450654 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] HTTP exception thrown: Instance bb885a17-8f70-412f-9319-6f48380cdeac could not be found. Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Request method failure captured: Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac HTTP/1.1 Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3bhecCROhg559l7k6U_enr0Hvh6lIA1bfD95Tam4VIDiIqYdoF7oCrVXCp1BhUt7gilM4vhdttkgI6BDDijC2mGNO8tfaQKHCjF2ZAj7_4FatiqrT1SoMiu_Q_DToTM8iektlE4E5SlylP897K-u16pRUV6d9X0fVtAb0wcS_Wql0 Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:00:34.453057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3aabb02cf14541f997b08fe0853acac0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3aabb02cf14541f997b08fe0853acac0"}]}] Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 3aabb02cf14541f997b08fe0853acac0 Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-648217540 Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 3dc4ac4ada004bbb942c36755f4a7cd1 Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-ServerRescueNegativeTestJSON-648217540-project Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance bb885a17-8f70-412f-9319-6f48380cdeac could not be found. Aug 31 11:00:34.454739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'bb885a17-8f70-412f-9319-6f48380cdeac'} Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb885a17-8f70-412f-9319-6f48380cdeac could not be found. Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:00:34.455540 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb885a17-8f70-412f-9319-6f48380cdeac could not be found. Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb885a17-8f70-412f-9319-6f48380cdeac could not be found. Aug 31 11:00:34.456761 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:00:34.460283 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] Returning 404 to user: Instance bb885a17-8f70-412f-9319-6f48380cdeac could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:00:34.461499 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7ae4818d-9ecd-47dc-a330-fde283b2f6de tempest-ServerRescueNegativeTestJSON-648217540 tempest-ServerRescueNegativeTestJSON-648217540-project] 10.222.0.75 "GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac" status: 404 len: 111 microversion: 2.1 time: 0.061717 Aug 31 11:00:34.462587 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 443/915] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:00:34 2022] GET /compute/v2.1/servers/bb885a17-8f70-412f-9319-6f48380cdeac => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:00:35.965209 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:35.965840 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:35.972362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:35.972872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:35.973302 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:35.974086 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:35.974535 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:35.974953 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:35.998845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lazy-loading 'flavor' on Instance uuid 1cd1f4b3-b876-4694-879d-791fb851a085 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:00:36.239332 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4439240e-303f-4238-bf33-1db97f96a8dc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/action" status: 202 len: 0 microversion: 2.20 time: 0.278051 Aug 31 11:00:36.240412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 473/916] 10.222.0.75 () {62 vars in 1319 bytes} [Wed Aug 31 11:00:35 2022] POST /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:00:36.248446 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:36.250026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:36.258722 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:36.259445 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:36.260076 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:36.260995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:36.261633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:36.262234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:36.495875 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:36.504399 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:36.506043 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:36.507350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-729a8c67-ecec-44a6-881a-f50286a488a0 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.262859 Aug 31 11:00:36.507996 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 444/917] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:36 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:37.751062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:37.751815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:37.760496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:37.760974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:37.761400 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:37.762128 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:37.762570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:37.762982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:38.036206 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:38.045294 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:38.046676 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:38.048059 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c934ab0a-6547-40cc-9eb1-fc7990e20232 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.521625 Aug 31 11:00:38.048796 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 474/918] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:37 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:39.072347 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:39.073097 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:39.080547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:39.081017 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:39.081448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:39.082259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:39.082659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:39.083081 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:39.218431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:39.226765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:39.228190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:39.229357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1375ca55-9b8f-423f-bfd7-9bd83d686c9d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.161444 Aug 31 11:00:39.229979 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 445/919] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:39 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:40.252894 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:40.253524 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:40.256223 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:40.261451 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:40.261982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:40.262412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:40.263137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:40.263586 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:40.264005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:40.400595 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:40.408834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:40.410337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:40.411514 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e82863a9-6fc6-455b-af76-6427aa91d034 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.162911 Aug 31 11:00:40.412077 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 475/920] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:40 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:41.434575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:41.435212 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:41.442754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:41.443319 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:41.443922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:41.445312 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:41.445877 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:41.446383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:41.587691 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:41.599425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:41.601243 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:41.602538 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-50d5fb54-486f-4d29-b369-ab010ab2bb43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.172055 Aug 31 11:00:41.603223 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 446/921] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:41 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:00:42.629577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:42.630483 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:42.638480 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:42.639052 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:42.639843 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:42.640353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:42.640892 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:42.641391 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:42.778138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:42.786662 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:42.788205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:42.789378 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c1529418-3ab6-48ae-90f5-449fa18a51cc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.166286 Aug 31 11:00:42.789956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 476/922] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:42 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:43.817165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:43.818159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:43.829564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:43.830382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:43.831113 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:43.832106 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:43.832571 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:43.832992 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:43.970888 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:43.979345 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:43.980786 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:43.981989 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f54051ff-1518-4092-aeaf-1f212d5d95a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.171871 Aug 31 11:00:43.982542 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 447/923] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:43 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:45.004911 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:45.005499 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:45.012564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:45.013057 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:45.013492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:45.014238 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:45.014692 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:45.015121 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:45.159106 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:45.160378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8f760601-35ab-44ec-8c7a-b03281496e48 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:45.160894 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8f760601-35ab-44ec-8c7a-b03281496e48 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:45.163491 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:45.168451 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:45.168779 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f760601-35ab-44ec-8c7a-b03281496e48 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:45.169275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f760601-35ab-44ec-8c7a-b03281496e48 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:45.169745 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f760601-35ab-44ec-8c7a-b03281496e48 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:45.170102 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:45.170494 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f760601-35ab-44ec-8c7a-b03281496e48 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:45.170951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f760601-35ab-44ec-8c7a-b03281496e48 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:45.171272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-013abfa5-5126-4d03-96a8-a87f8fac1281 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.170585 Aug 31 11:00:45.171375 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8f760601-35ab-44ec-8c7a-b03281496e48 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:45.171857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 477/924] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:44 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:45.198907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8f760601-35ab-44ec-8c7a-b03281496e48 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/ips" status: 200 len: 146 microversion: 2.1 time: 0.042420 Aug 31 11:00:45.199500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 448/925] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 11:00:45 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:46.196686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:46.197296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:46.204176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:46.204666 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:46.205131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:46.205840 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:46.206295 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:46.206717 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:46.347961 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:46.356284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:46.357715 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:46.358972 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-385df04d-f543-4bf0-99f8-7c7687945680 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.166222 Aug 31 11:00:46.359554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 478/926] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:46 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:00:46.543474 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-566f3fdc-3fdc-4ef0-af1f-17af31e7dff9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e033fe46-0a01-4c63-b569-88af6b76c796"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:46.546051 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-566f3fdc-3fdc-4ef0-af1f-17af31e7dff9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:46.553084 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-566f3fdc-3fdc-4ef0-af1f-17af31e7dff9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:46.553573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-566f3fdc-3fdc-4ef0-af1f-17af31e7dff9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:46.554108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-566f3fdc-3fdc-4ef0-af1f-17af31e7dff9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:46.554840 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-566f3fdc-3fdc-4ef0-af1f-17af31e7dff9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:46.555320 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-566f3fdc-3fdc-4ef0-af1f-17af31e7dff9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:46.555758 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-566f3fdc-3fdc-4ef0-af1f-17af31e7dff9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:46.831088 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-566f3fdc-3fdc-4ef0-af1f-17af31e7dff9 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291484 Aug 31 11:00:46.831894 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 449/927] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 11:00:46 2022] POST /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:00:47.382231 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:47.382991 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:47.389352 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:47.389856 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:47.390312 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:47.390989 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:47.391437 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:47.391855 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:47.533423 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:47.542082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:47.543641 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:47.544901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-146e4628-2085-4300-9f4e-25dd20e86e4f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.166650 Aug 31 11:00:47.545569 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 479/928] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:47 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:48.572398 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:48.573266 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:48.582181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:48.582784 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:48.583325 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:48.584230 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:48.584787 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:48.585314 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:48.603978 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:48.729222 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:48.739869 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:48.741633 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:48.742999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bf85c9c2-5880-4ecc-8369-a1fd6b99056c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.176899 Aug 31 11:00:48.743740 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 450/929] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:48 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:49.768477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:49.769149 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:49.778756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:49.779251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:49.779709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:49.780409 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:49.780861 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:49.781314 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:49.925016 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:49.933534 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:49.934982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:49.936528 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a4d00ef2-c568-49ea-8cfb-7f0727d2df20 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.173226 Aug 31 11:00:49.937084 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 480/930] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:49 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:50.963286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:50.963943 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:50.971463 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:50.972011 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:50.972494 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:50.973279 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:50.973803 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:50.974282 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:51.128793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:51.137492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:51.138976 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:51.140175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c74d31ef-1ef5-4ea7-b632-26e4e25daf2f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.182787 Aug 31 11:00:51.140734 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 451/931] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:50 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:52.164432 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:52.165036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:52.171944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:52.172457 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:52.172891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:52.173609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:52.174105 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:52.174530 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:52.332724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:52.346008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:52.348392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:52.350349 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-74546aa5-d26a-4ba1-b200-b1b36fb2633a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.190362 Aug 31 11:00:52.351272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 481/932] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:52 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:53.374165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:53.374785 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:53.381402 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:53.381936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:53.382374 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:53.383070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:53.383713 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:53.384144 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:53.520243 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:53.529046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:53.530559 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:53.531698 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-49af2af8-7612-4c62-881c-2a63a6a48557 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.161586 Aug 31 11:00:53.532245 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 452/933] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:53 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:54.394304 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e88ccfe7-ae1e-459c-a9ad-0d8f68cbb42b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:54.396766 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e88ccfe7-ae1e-459c-a9ad-0d8f68cbb42b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:54.403764 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e88ccfe7-ae1e-459c-a9ad-0d8f68cbb42b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:54.404364 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e88ccfe7-ae1e-459c-a9ad-0d8f68cbb42b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:54.405012 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e88ccfe7-ae1e-459c-a9ad-0d8f68cbb42b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:54.405841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e88ccfe7-ae1e-459c-a9ad-0d8f68cbb42b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:54.406618 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e88ccfe7-ae1e-459c-a9ad-0d8f68cbb42b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:54.407348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e88ccfe7-ae1e-459c-a9ad-0d8f68cbb42b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:54.445943 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e88ccfe7-ae1e-459c-a9ad-0d8f68cbb42b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055511 Aug 31 11:00:54.446836 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 482/934] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:00:54 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:54.457914 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3390b48a-b7d7-4c1c-ac12-2cfe7f8311c7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:54.458405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3390b48a-b7d7-4c1c-ac12-2cfe7f8311c7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:54.465035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3390b48a-b7d7-4c1c-ac12-2cfe7f8311c7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:54.465521 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3390b48a-b7d7-4c1c-ac12-2cfe7f8311c7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:54.466191 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3390b48a-b7d7-4c1c-ac12-2cfe7f8311c7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:54.467016 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3390b48a-b7d7-4c1c-ac12-2cfe7f8311c7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:54.467469 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3390b48a-b7d7-4c1c-ac12-2cfe7f8311c7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:54.467942 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3390b48a-b7d7-4c1c-ac12-2cfe7f8311c7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:54.497794 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3390b48a-b7d7-4c1c-ac12-2cfe7f8311c7 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/e033fe46-0a01-4c63-b569-88af6b76c796" status: 200 len: 194 microversion: 2.1 time: 0.043860 Aug 31 11:00:54.498397 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 453/935] 10.222.0.75 () {58 vars in 1413 bytes} [Wed Aug 31 11:00:54 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/e033fe46-0a01-4c63-b569-88af6b76c796 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:54.556064 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:54.556733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:54.563383 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:54.563872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:54.564288 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:54.564996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:54.565448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:54.565900 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:54.712052 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:54.723334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:54.726227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:54.728088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a38691c6-f463-4092-b346-8144d047571c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.176928 Aug 31 11:00:54.728752 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 483/936] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:54 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:55.755259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:55.756047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:55.762745 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:55.763227 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:55.763666 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:55.764337 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:55.764928 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:55.765366 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:55.851296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6a211f76-ae12-466e-83b2-361c3af1d0ac tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b3e4c59-6ec2-45b0-8f98-1c768e4e05da"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:00:55.853755 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6a211f76-ae12-466e-83b2-361c3af1d0ac tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:55.862360 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a211f76-ae12-466e-83b2-361c3af1d0ac tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:55.862863 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a211f76-ae12-466e-83b2-361c3af1d0ac tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:55.863296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a211f76-ae12-466e-83b2-361c3af1d0ac tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:55.864022 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a211f76-ae12-466e-83b2-361c3af1d0ac tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:55.864693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a211f76-ae12-466e-83b2-361c3af1d0ac tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:55.865281 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6a211f76-ae12-466e-83b2-361c3af1d0ac tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:55.946653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:55.956550 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:55.958016 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:55.959549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8365d7f5-66e7-41c1-b61c-bb25da866d7f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.208611 Aug 31 11:00:55.960215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 454/937] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:55 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:56.138173 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:56.160439 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6a211f76-ae12-466e-83b2-361c3af1d0ac tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "POST /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313124 Aug 31 11:00:56.161102 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 484/938] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 11:00:55 2022] POST /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:56.983085 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:56.983693 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:56.990724 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:56.991205 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:56.991631 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:56.992326 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:56.992773 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:56.993188 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:57.129961 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:57.138680 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:57.140103 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:57.141588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-514cbc9c-dc4b-436c-9b60-17d6d5bc0c43 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1743 microversion: 2.20 time: 0.162297 Aug 31 11:00:57.142176 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 455/939] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:56 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:58.168279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:58.169016 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:58.175688 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:58.176182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:58.176622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:58.177334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:58.177806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:58.178241 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:58.328296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:58.337185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:58.338682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:58.339989 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6b464530-f8d0-427f-b31e-b5906699de19 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1743 microversion: 2.20 time: 0.177503 Aug 31 11:00:58.340608 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 485/940] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:58 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:00:58.409172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-08eb81c1-e6a6-4cf3-8421-deed4548affa tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:58.411435 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-08eb81c1-e6a6-4cf3-8421-deed4548affa tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:58.418243 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-08eb81c1-e6a6-4cf3-8421-deed4548affa tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:58.418744 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-08eb81c1-e6a6-4cf3-8421-deed4548affa tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:58.419185 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-08eb81c1-e6a6-4cf3-8421-deed4548affa tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:58.419883 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-08eb81c1-e6a6-4cf3-8421-deed4548affa tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:58.420338 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-08eb81c1-e6a6-4cf3-8421-deed4548affa tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:58.420759 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-08eb81c1-e6a6-4cf3-8421-deed4548affa tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:58.455233 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-08eb81c1-e6a6-4cf3-8421-deed4548affa tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050229 Aug 31 11:00:58.456009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 456/941] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:00:58 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:58.610056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5d758a29-c28a-4791-b70e-f078f525ffb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:58.610666 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5d758a29-c28a-4791-b70e-f078f525ffb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:58.618040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5d758a29-c28a-4791-b70e-f078f525ffb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:58.618538 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5d758a29-c28a-4791-b70e-f078f525ffb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:58.619019 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5d758a29-c28a-4791-b70e-f078f525ffb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:58.619834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5d758a29-c28a-4791-b70e-f078f525ffb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:58.620242 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5d758a29-c28a-4791-b70e-f078f525ffb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:58.620673 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5d758a29-c28a-4791-b70e-f078f525ffb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:58.655336 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5d758a29-c28a-4791-b70e-f078f525ffb5 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/e033fe46-0a01-4c63-b569-88af6b76c796" status: 200 len: 194 microversion: 2.1 time: 0.049476 Aug 31 11:00:58.656018 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 486/942] 10.222.0.75 () {58 vars in 1413 bytes} [Wed Aug 31 11:00:58 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/e033fe46-0a01-4c63-b569-88af6b76c796 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:00:58.666712 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:58.667221 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:58.673420 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:58.673959 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:58.674401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:58.675096 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:58.675548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:58.675973 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:58.764966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lazy-loading 'services' on Instance uuid 175e5c4c-5bf1-44fb-81aa-7268900587c1 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:00:58.840735 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-97fadc2e-0246-4663-b6ab-33e8f743d541 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "DELETE /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/e033fe46-0a01-4c63-b569-88af6b76c796" status: 202 len: 0 microversion: 2.1 time: 0.177908 Aug 31 11:00:58.841347 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 457/943] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 11:00:58 2022] DELETE /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/e033fe46-0a01-4c63-b569-88af6b76c796 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:00:59.363578 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:00:59.364265 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:00:59.370926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:59.371569 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:59.372073 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:59.373063 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:00:59.373592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:00:59.374093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:00:59.509361 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:59.518665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:59.520252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:00:59.521445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d0280658-e889-483e-b8cc-71877763fa8a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1743 microversion: 2.20 time: 0.161939 Aug 31 11:00:59.522063 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 487/944] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:00:59 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:00.548806 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:00.553361 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-f5b97c87-780f-4e5d-b398-68f3cd950141 req-d5a2eb11-9e56-4e4d-aa1e-652865f08d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd1f4b3-b876-4694-879d-791fb851a085", "name": "network-vif-plugged", "status": "completed", "tag": "13802481-258c-4015-b25a-d35749ab72e3"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:00.554975 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:00.580346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:00.581083 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:00.582440 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:00.584589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:00.585299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:00.586333 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:00.587733 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-f5b97c87-780f-4e5d-b398-68f3cd950141 req-d5a2eb11-9e56-4e4d-aa1e-652865f08d4b service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:00.588541 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-f5b97c87-780f-4e5d-b398-68f3cd950141 req-d5a2eb11-9e56-4e4d-aa1e-652865f08d4b service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:00.590370 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-f5b97c87-780f-4e5d-b398-68f3cd950141 req-d5a2eb11-9e56-4e4d-aa1e-652865f08d4b service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:00.612102 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-f5b97c87-780f-4e5d-b398-68f3cd950141 req-d5a2eb11-9e56-4e4d-aa1e-652865f08d4b service nova] Creating event network-vif-plugged:13802481-258c-4015-b25a-d35749ab72e3 for instance 1cd1f4b3-b876-4694-879d-791fb851a085 on hv-cinder-79578 Aug 31 11:01:00.622948 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-f5b97c87-780f-4e5d-b398-68f3cd950141 req-d5a2eb11-9e56-4e4d-aa1e-652865f08d4b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089424 Aug 31 11:01:00.623678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 458/945] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:00.744946 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:00.754169 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:00.755650 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:00.756825 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7cd02f95-4c7b-4762-ba90-4ac3d4d043af tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1738 microversion: 2.20 time: 0.216189 Aug 31 11:01:00.757389 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 488/946] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:00 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:01.025608 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-192720ee-1c43-4e2e-aac4-b996f5f15048 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:01.026696 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-192720ee-1c43-4e2e-aac4-b996f5f15048 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:01.033379 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-192720ee-1c43-4e2e-aac4-b996f5f15048 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:01.033892 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-192720ee-1c43-4e2e-aac4-b996f5f15048 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:01.034494 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-192720ee-1c43-4e2e-aac4-b996f5f15048 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:01.035174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-192720ee-1c43-4e2e-aac4-b996f5f15048 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:01.035966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-192720ee-1c43-4e2e-aac4-b996f5f15048 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:01.036274 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-192720ee-1c43-4e2e-aac4-b996f5f15048 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:01.069835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-192720ee-1c43-4e2e-aac4-b996f5f15048 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/8b3e4c59-6ec2-45b0-8f98-1c768e4e05da" status: 200 len: 194 microversion: 2.1 time: 0.049581 Aug 31 11:01:01.070793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 459/947] 10.222.0.75 () {58 vars in 1413 bytes} [Wed Aug 31 11:01:01 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/8b3e4c59-6ec2-45b0-8f98-1c768e4e05da => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:01.081390 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:01.081931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:01.088254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:01.088933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:01.089539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:01.090321 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:01.091035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:01.091652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:01.181295 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.objects.instance [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lazy-loading 'services' on Instance uuid 175e5c4c-5bf1-44fb-81aa-7268900587c1 {{(pid=120482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:01:01.267472 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2c129e38-b3e1-48a4-ba24-d279e9b40f4d tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "DELETE /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/8b3e4c59-6ec2-45b0-8f98-1c768e4e05da" status: 202 len: 0 microversion: 2.1 time: 0.189994 Aug 31 11:01:01.268512 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 489/948] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 11:01:01 2022] DELETE /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments/8b3e4c59-6ec2-45b0-8f98-1c768e4e05da => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:01:01.780518 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:01.781332 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:01.796507 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:01.797104 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:01.797635 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:01.798469 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:01.798998 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:01.799491 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:02.004017 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:02.015281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:02.040657 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:02.046487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-aea23929-ba6c-457a-b26e-6c230a8916a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1738 microversion: 2.20 time: 0.269121 Aug 31 11:01:02.065089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 460/949] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:01 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:02.478436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a4ff0962-a8c3-406e-a546-58cfad4cc245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:02.481945 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a4ff0962-a8c3-406e-a546-58cfad4cc245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:02.489337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4ff0962-a8c3-406e-a546-58cfad4cc245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:02.490131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4ff0962-a8c3-406e-a546-58cfad4cc245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:02.490909 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4ff0962-a8c3-406e-a546-58cfad4cc245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:02.491869 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4ff0962-a8c3-406e-a546-58cfad4cc245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:02.492568 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4ff0962-a8c3-406e-a546-58cfad4cc245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:02.493265 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a4ff0962-a8c3-406e-a546-58cfad4cc245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:02.529272 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a4ff0962-a8c3-406e-a546-58cfad4cc245 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055631 Aug 31 11:01:02.529835 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 490/950] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:02 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:01:02.652766 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7f1f1f41-4701-4e79-98b3-97406f77926a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:02.655395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7f1f1f41-4701-4e79-98b3-97406f77926a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:02.663249 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1f1f41-4701-4e79-98b3-97406f77926a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:02.664034 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1f1f41-4701-4e79-98b3-97406f77926a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:02.664678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1f1f41-4701-4e79-98b3-97406f77926a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:02.665564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1f1f41-4701-4e79-98b3-97406f77926a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:02.666323 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1f1f41-4701-4e79-98b3-97406f77926a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:02.666869 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1f1f41-4701-4e79-98b3-97406f77926a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:02.703332 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7f1f1f41-4701-4e79-98b3-97406f77926a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054702 Aug 31 11:01:02.704210 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 461/951] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:02 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:01:02.774223 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:02.774727 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:02.782669 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:02.783159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:02.783590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:02.784290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:02.784741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:02.785153 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:02.814124 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:01:02.938721 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-519c1228-0ec0-482b-93e0-a3d3b1f5074c tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "DELETE /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 204 len: 0 microversion: 2.1 time: 0.167792 Aug 31 11:01:02.939745 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 491/952] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:01:02 2022] DELETE /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:01:02.949726 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:02.950466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:02.957125 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:02.958039 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:02.958446 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:02.959351 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:02.960005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:02.960605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:03.073931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:03.075112 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:03.081587 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:03.082394 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:03.083098 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:03.084162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:03.084803 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:03.085412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:03.145253 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:03.154132 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d51c896f-c013-4d6a-a926-150ada04cb2b tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1675 microversion: 2.1 time: 0.209634 Aug 31 11:01:03.155383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 462/953] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:02 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1675 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:03.252827 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:03.261978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:03.263550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:03.264813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e8a4753d-7438-4628-b8c1-8a5e92ba4242 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1738 microversion: 2.20 time: 0.195438 Aug 31 11:01:03.272564 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 492/954] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:03 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:03.613258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:03.613700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:03.620896 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:03.621508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:03.621990 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:03.622781 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:03.623180 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:03.623609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:03.649481 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lazy-loading 'flavor' on Instance uuid c91b10cf-8d7d-4896-be69-bc4c8089a324 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:01:03.750963 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-420b2570-77f6-45b2-9c63-0fba1783a397 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "POST /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324/action" status: 202 len: 0 microversion: 2.1 time: 0.141287 Aug 31 11:01:03.751774 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 463/955] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 11:01:03 2022] POST /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:01:03.762768 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:03.763368 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:03.769842 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:03.770317 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:03.770741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:03.771426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:03.771874 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:03.772292 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:03.926995 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:03.935406 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5407a856-07f8-4448-8a7a-30487d81ed8f tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.177643 Aug 31 11:01:03.936910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 493/956] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:03 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:01:04.178063 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:04.178780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:04.185536 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:04.186378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:04.186807 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:04.187506 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:04.187951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:04.188350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:04.290308 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:04.290308 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:04.297537 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:04.298210 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:04.298676 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:04.299430 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:04.299888 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:04.300466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:04.343328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:04.351372 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c9e83091-befe-4d08-8403-53db101a64f2 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1675 microversion: 2.1 time: 0.178833 Aug 31 11:01:04.352145 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 464/957] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:04 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:04.464467 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:04.475278 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:04.477663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:04.478979 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cb74a42e-6207-4df0-86f6-63711a5f647c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1738 microversion: 2.20 time: 0.194101 Aug 31 11:01:04.494590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 494/958] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:04 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:04.961951 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:04.962756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:04.970392 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:04.971146 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:04.971881 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:04.972584 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:04.973031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:04.973447 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:04.976408 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:05.128234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:05.136533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6bdcbb2c-0b14-4cf0-8015-405373ed3bc1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.178658 Aug 31 11:01:05.150339 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 465/959] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:04 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:05.374162 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:05.374748 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:05.384533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:05.385020 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:05.385464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:05.386296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:05.386748 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:05.387196 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:05.503683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:05.504408 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:05.512497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:05.513026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:05.513454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:05.514215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:05.514664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:05.515079 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:05.553499 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:05.566122 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0f830da7-7eca-48cf-b6cc-0f5fa22e072a tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1675 microversion: 2.1 time: 0.192585 Aug 31 11:01:05.566122 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 495/960] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:05 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1675 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:05.665905 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:05.675161 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:05.676906 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:05.678147 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5b3d6787-6811-439f-beb3-8afa04e1a1da tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1738 microversion: 2.20 time: 0.178492 Aug 31 11:01:05.688058 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 466/961] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:05 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:06.160253 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:06.160873 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:06.167305 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:06.167796 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:06.168260 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:06.168962 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:06.169418 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:06.169993 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:06.327927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:06.336014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2df47e87-7ed7-4beb-9229-fa99060060fd tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.179729 Aug 31 11:01:06.337560 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 496/962] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:06 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:06.587034 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:06.587652 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:06.595130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:06.595964 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:06.596609 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:06.597506 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:06.598146 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:06.598819 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:06.701303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:06.702575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:06.715275 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:06.715772 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:06.716209 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:06.716992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:06.717450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:06.717930 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:06.744124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:06.757242 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ec87545e-1ef5-4452-94a6-5ef871882f86 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1675 microversion: 2.1 time: 0.174177 Aug 31 11:01:06.771789 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 467/963] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:06 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:06.882913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:06.893631 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:06.895237 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:06.896354 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-69aabeb5-c4ae-426c-add8-6c6c60505a35 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1738 microversion: 2.20 time: 0.199188 Aug 31 11:01:06.897118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 497/964] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:06 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:07.361179 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:07.361791 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:07.369160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:07.369646 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:07.372678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:07.373449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:07.373953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:07.374370 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:07.523228 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:07.531942 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a72b1c0b-4bb1-481c-a6e3-504606c9dfb3 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.174385 Aug 31 11:01:07.532275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 468/965] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:07 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:01:07.781558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:07.782336 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:07.793001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:07.793562 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:07.794036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:07.794779 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:07.795448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:07.795915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:07.815938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:07.919886 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:07.921764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:07.929316 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:07.930224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:07.930881 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:07.932031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:07.932681 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:07.933295 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:07.957164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:07.966712 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-aecd5ad4-6b9c-4032-bdc3-2da7be29e2d0 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1675 microversion: 2.1 time: 0.189971 Aug 31 11:01:07.967621 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 498/966] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:07 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:08.088069 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:08.096526 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:08.098022 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:08.099234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-26b0da97-f216-40b7-b561-1194a4798425 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1738 microversion: 2.20 time: 0.183499 Aug 31 11:01:08.100026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 469/967] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:07 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:01:08.561652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:08.562343 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:08.569034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:08.569548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:08.570241 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:08.571075 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:08.571551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:08.571991 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:08.719682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:08.728620 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6791df23-f63e-4f43-b3d2-65a42999e7bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.176531 Aug 31 11:01:08.729211 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 499/968] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:08 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:08.989886 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:08.990606 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:08.998164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:08.998653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:08.999089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:08.999823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:09.000271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:09.000694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:09.123367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:09.124730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:09.137125 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:09.137883 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:09.138424 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:09.139285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:09.139918 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:09.140488 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:09.183037 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:09.192002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6277fae7-7346-4d21-8d60-ced263108580 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1675 microversion: 2.1 time: 0.206950 Aug 31 11:01:09.192969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 470/969] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:08 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:09.416432 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:09.430075 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:09.432743 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:09.436208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3136ebfd-d905-4994-a95f-14e1916f4b71 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1738 microversion: 2.20 time: 0.316922 Aug 31 11:01:09.441567 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 500/970] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:09 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1738 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:09.751207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:09.754724 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:09.764887 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:09.767087 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:09.768263 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:09.770798 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:09.772332 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:09.787551 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:10.116507 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:10.124763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f387b67a-d387-45bf-8c2e-a8f00ebbd0cf tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.377659 Aug 31 11:01:10.125348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 471/971] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:09 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:10.213931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:10.214821 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:10.221811 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:10.222343 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:10.222782 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:10.223490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:10.223934 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:10.224417 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:10.319783 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-45f9de0e-32b0-4096-b1de-dc7256de1927 req-b5badca1-267a-419c-8481-f7e20d5768b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "175e5c4c-5bf1-44fb-81aa-7268900587c1", "name": "network-vif-deleted", "tag": "e5e74a0f-e2bc-43c1-b648-b96bf8f85107"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:10.321395 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb16c0b86444a59ab299013c694cb07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd581788f9ca4c2fb1ba3fe02f34b29d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:10.330167 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f98aa894-6078-4224-870d-aac7d5cad053 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 200 len: 1607 microversion: 2.1 time: 0.120057 Aug 31 11:01:10.331148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 501/972] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:10 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 1607 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:10.348295 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-45f9de0e-32b0-4096-b1de-dc7256de1927 req-b5badca1-267a-419c-8481-f7e20d5768b2 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:10.348775 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-45f9de0e-32b0-4096-b1de-dc7256de1927 req-b5badca1-267a-419c-8481-f7e20d5768b2 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:10.349210 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-45f9de0e-32b0-4096-b1de-dc7256de1927 req-b5badca1-267a-419c-8481-f7e20d5768b2 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:10.362941 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-45f9de0e-32b0-4096-b1de-dc7256de1927 req-b5badca1-267a-419c-8481-f7e20d5768b2 service nova] Creating event network-vif-deleted:e5e74a0f-e2bc-43c1-b648-b96bf8f85107 for instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 on hv-cinder-79578 Aug 31 11:01:10.368083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-45f9de0e-32b0-4096-b1de-dc7256de1927 req-b5badca1-267a-419c-8481-f7e20d5768b2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052057 Aug 31 11:01:10.368679 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 472/973] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:10.468817 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:10.469613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:10.471757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:10.477401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:10.478005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:10.478507 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:10.479280 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:10.479786 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:10.480297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:10.630482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:10.639348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:10.640862 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:10.642157 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-592dc388-e791-4d8e-af63-9f2421948dfd tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1738 microversion: 2.20 time: 0.178242 Aug 31 11:01:10.642799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 502/974] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:10 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:11.147017 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:11.147705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:11.154122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:11.154866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:11.155486 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:11.156359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:11.156973 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:11.157805 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:11.355504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:11.356146 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:11.363164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:11.363944 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:11.364383 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:11.365099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:11.365887 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:11.365998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:11.380865 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] HTTP exception thrown: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Request method failure captured: Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 HTTP/1.1 Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3XUiRhnkMZBkslrexasVHr3ldD7vHChhlU6vvjN4se-XHj1LVD14G2JGtzYwVlGR8JpLm-vZA71Iaj2ZHdpNzFI61KFdeD5NkPJy7leM07s0vRGa1BmSCVOzpbKCxd5KAwAY8mkzAPcbhxHPNPZ4JMbPE28L77x_-q2yX5hjmuhLs Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:01:11.382619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}] Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: cbb16c0b86444a59ab299013c694cb07 Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:11.384264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '175e5c4c-5bf1-44fb-81aa-7268900587c1'} Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:11.385462 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:11.387270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:11.389069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Returning 404 to user: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:11.389069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d146db6d-1810-4561-bdfa-aa5f976d27ff tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 404 len: 111 microversion: 2.1 time: 0.032663 Aug 31 11:01:11.389069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 503/975] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:11 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 11:01:11.393734 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f1a277c1-d51e-4efe-a7b7-ea989b069b45 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '.version_select at 0x7f37a8d4d670>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:11.416803 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f1a277c1-d51e-4efe-a7b7-ea989b069b45 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523580971" status: 202 len: 0 microversion: 2.1 time: 0.026673 Aug 31 11:01:11.417552 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 504/976] 10.222.0.75 () {58 vars in 1221 bytes} [Wed Aug 31 11:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523580971 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 11:01:11.447181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:11.456407 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-26a9b141-59ba-4d05-9908-d7f47d04e2a6 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.314051 Aug 31 11:01:11.457313 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 473/977] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:11 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:11.665130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:11.665971 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:11.673482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:11.674119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:11.674636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:11.675505 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:11.676112 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:11.676665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:11.885197 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:11.894099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:11.895577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:11.896883 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1a80dddb-1bb7-4080-b57f-d7b7667afacc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1720 microversion: 2.20 time: 0.236010 Aug 31 11:01:11.897634 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 505/978] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:11 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:12.478573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:12.479202 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:12.485950 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:12.486440 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:12.486866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:12.487560 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:12.488009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:12.488421 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:12.626847 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:12.635449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-02cafd4f-3f0a-414f-931d-da448763529e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.160956 Aug 31 11:01:12.636151 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 474/979] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:12 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:12.923535 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:12.924264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:12.932541 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:12.933122 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:12.933636 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:12.934543 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:12.935082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:12.935580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:13.071575 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:13.080239 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:13.081674 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:13.082897 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-75e3f0e2-85b2-4990-b535-80b67f77f6a6 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1720 microversion: 2.20 time: 0.164959 Aug 31 11:01:13.083438 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 506/980] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:12 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:13.656431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:13.657073 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:13.663814 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:13.664300 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:13.664729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:13.665417 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:13.665887 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:13.666292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:13.809412 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:13.819860 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c63c936f-71ee-4552-9978-0a37a5fbf54c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.167157 Aug 31 11:01:13.820425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 475/981] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:13 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:14.110799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:14.111963 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:14.127188 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.127673 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.128103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.128845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.129299 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.129723 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.275500 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:14.285036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:14.286508 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:14.287690 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-676396d4-65ea-4af8-95b6-dc12fbb1b850 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1723 microversion: 2.20 time: 0.184703 Aug 31 11:01:14.288261 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 507/982] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:14 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:14.311511 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7752f08c-66ad-4894-83c2-2e8be6f1f5a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3aac122a-8320-49c2-a182-936df72b6625"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:14.313933 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7752f08c-66ad-4894-83c2-2e8be6f1f5a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:14.321889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7752f08c-66ad-4894-83c2-2e8be6f1f5a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.322402 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7752f08c-66ad-4894-83c2-2e8be6f1f5a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.322839 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7752f08c-66ad-4894-83c2-2e8be6f1f5a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.323545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7752f08c-66ad-4894-83c2-2e8be6f1f5a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.324712 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7752f08c-66ad-4894-83c2-2e8be6f1f5a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.325489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7752f08c-66ad-4894-83c2-2e8be6f1f5a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.438771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:14.439647 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:14.445965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.446454 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.446891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.447576 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.448273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.448659 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.465547 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] HTTP exception thrown: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Request method failure captured: Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: DELETE /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 HTTP/1.1 Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3XUiRhnkMZBkslrexasVHr3ldD7vHChhlU6vvjN4se-XHj1LVD14G2JGtzYwVlGR8JpLm-vZA71Iaj2ZHdpNzFI61KFdeD5NkPJy7leM07s0vRGa1BmSCVOzpbKCxd5KAwAY8mkzAPcbhxHPNPZ4JMbPE28L77x_-q2yX5hjmuhLs Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:01:14.467771 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}] Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: cbb16c0b86444a59ab299013c694cb07 Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.469337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '175e5c4c-5bf1-44fb-81aa-7268900587c1'} Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:14.470279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.471813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.473270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Returning 404 to user: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:14.473270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-bb7a30bd-df68-4c4c-bdd0-48aea18b0091 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "DELETE /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 404 len: 111 microversion: 2.1 time: 0.035818 Aug 31 11:01:14.473270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 508/983] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:01:14 2022] DELETE /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:14.482516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:14.483379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 175e5c4c-5bf1-44fb-81aa-7268900587c1] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:14.490413 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.491207 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.491939 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.493349 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.493834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.494262 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.508055 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] HTTP exception thrown: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Request method failure captured: Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 HTTP/1.1 Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3XUiRhnkMZBkslrexasVHr3ldD7vHChhlU6vvjN4se-XHj1LVD14G2JGtzYwVlGR8JpLm-vZA71Iaj2ZHdpNzFI61KFdeD5NkPJy7leM07s0vRGa1BmSCVOzpbKCxd5KAwAY8mkzAPcbhxHPNPZ4JMbPE28L77x_-q2yX5hjmuhLs Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:01:14.509589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}] Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: cbb16c0b86444a59ab299013c694cb07 Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.511069 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '175e5c4c-5bf1-44fb-81aa-7268900587c1'} Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:14.511823 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. Aug 31 11:01:14.513087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:14.514301 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Returning 404 to user: Instance 175e5c4c-5bf1-44fb-81aa-7268900587c1 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:14.514301 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3b2d534b-88bb-4287-ab73-61c7121e9513 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1" status: 404 len: 111 microversion: 2.1 time: 0.035284 Aug 31 11:01:14.514301 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 509/984] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:14 2022] GET /compute/v2.1/servers/175e5c4c-5bf1-44fb-81aa-7268900587c1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:14.530840 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-76899c76-3d15-412d-9029-035cd83f944f req-247051b3-bcdc-4e7b-adc1-2c44f5c301a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd1f4b3-b876-4694-879d-791fb851a085", "name": "network-vif-unplugged", "status": "completed", "tag": "13802481-258c-4015-b25a-d35749ab72e3"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:14.542452 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-76899c76-3d15-412d-9029-035cd83f944f req-247051b3-bcdc-4e7b-adc1-2c44f5c301a1 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.542982 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-76899c76-3d15-412d-9029-035cd83f944f req-247051b3-bcdc-4e7b-adc1-2c44f5c301a1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.543422 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-76899c76-3d15-412d-9029-035cd83f944f req-247051b3-bcdc-4e7b-adc1-2c44f5c301a1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.557652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.compute.server_external_events [req-76899c76-3d15-412d-9029-035cd83f944f req-247051b3-bcdc-4e7b-adc1-2c44f5c301a1 service nova] Unable to find a host for instance 1cd1f4b3-b876-4694-879d-791fb851a085. Dropping event network-vif-unplugged {{(pid=120482) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 11:01:14.558569 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-76899c76-3d15-412d-9029-035cd83f944f req-247051b3-bcdc-4e7b-adc1-2c44f5c301a1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031775 Aug 31 11:01:14.559509 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 510/985] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 11:01:14.667684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7752f08c-66ad-4894-83c2-2e8be6f1f5a9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.360666 Aug 31 11:01:14.669835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 476/986] 10.222.0.75 () {62 vars in 1364 bytes} [Wed Aug 31 11:01:14 2022] POST /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/os-volume_attachments => generated 188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 11:01:14.797096 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d52fdd1a-6a46-4644-a231-11b300a3bed7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:14.797590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d52fdd1a-6a46-4644-a231-11b300a3bed7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:14.803711 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52fdd1a-6a46-4644-a231-11b300a3bed7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.804197 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52fdd1a-6a46-4644-a231-11b300a3bed7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.804629 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52fdd1a-6a46-4644-a231-11b300a3bed7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.805324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52fdd1a-6a46-4644-a231-11b300a3bed7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.805795 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52fdd1a-6a46-4644-a231-11b300a3bed7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.806217 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52fdd1a-6a46-4644-a231-11b300a3bed7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.841983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:14.843128 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:14.849933 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.850561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.850989 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.851730 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:14.852178 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:14.852643 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:14.989748 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:14.997543 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c5ba79c9-344c-40d6-8214-b149e5f56487 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.160491 Aug 31 11:01:14.998140 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 477/987] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:14 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:15.045298 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d52fdd1a-6a46-4644-a231-11b300a3bed7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/os-volume_attachments/3aac122a-8320-49c2-a182-936df72b6625" status: 202 len: 0 microversion: 2.20 time: 0.252302 Aug 31 11:01:15.045907 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 511/988] 10.222.0.75 () {60 vars in 1457 bytes} [Wed Aug 31 11:01:14 2022] DELETE /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/os-volume_attachments/3aac122a-8320-49c2-a182-936df72b6625 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:01:15.109921 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:15.110580 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:15.116811 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:15.117353 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:15.117859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:15.118631 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:15.119156 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:15.119634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:15.149547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120481) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 11:01:15.208568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:15.228699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-42879aeb-5d51-450f-a143-aa1d197951bc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "POST /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/action" status: 202 len: 0 microversion: 2.20 time: 0.123010 Aug 31 11:01:15.229870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 478/989] 10.222.0.75 () {62 vars in 1319 bytes} [Wed Aug 31 11:01:15 2022] POST /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:01:15.238754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:15.239416 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:15.247027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:15.247720 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:15.248521 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:15.249594 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:15.250110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:15.250588 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:15.395584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:15.404637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:15.406193 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:15.407484 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5cb6981b-7e72-49b0-b875-974e0a50556b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1671 microversion: 2.20 time: 0.173416 Aug 31 11:01:15.408154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 512/990] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:15 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:15.816627 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:15.817252 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:15.819266 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:15.824830 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:15.825313 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:15.825729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:15.826509 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:15.826945 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:15.827385 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:15.994429 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] HTTP exception thrown: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Request method failure captured: Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: DELETE /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 HTTP/1.1 Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3XUiRhnkMZBkslrexasVHr3ldD7vHChhlU6vvjN4se-XHj1LVD14G2JGtzYwVlGR8JpLm-vZA71Iaj2ZHdpNzFI61KFdeD5NkPJy7leM07s0vRGa1BmSCVOzpbKCxd5KAwAY8mkzAPcbhxHPNPZ4JMbPE28L77x_-q2yX5hjmuhLs Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:01:15.996095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}] Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: cbb16c0b86444a59ab299013c694cb07 Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:15.997634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '62fc001e-fe00-44da-8493-aaf6fc2cd297'} Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:15.998582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:16.000031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:16.001535 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Returning 404 to user: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:16.001535 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7e7a6f3e-a7d1-46e7-96d0-342968204ae6 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "DELETE /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 404 len: 111 microversion: 2.1 time: 0.185553 Aug 31 11:01:16.001535 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 479/991] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:01:15 2022] DELETE /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:16.006108 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:16.006728 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] [instance: 62fc001e-fe00-44da-8493-aaf6fc2cd297] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:16.012681 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:16.013173 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:16.013606 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:16.014418 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:16.015227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:16.015659 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:16.021239 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:16.021870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:16.029299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:16.029652 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] HTTP exception thrown: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:16.029969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:16.030434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Request method failure captured: Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 HTTP/1.1 Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3XUiRhnkMZBkslrexasVHr3ldD7vHChhlU6vvjN4se-XHj1LVD14G2JGtzYwVlGR8JpLm-vZA71Iaj2ZHdpNzFI61KFdeD5NkPJy7leM07s0vRGa1BmSCVOzpbKCxd5KAwAY8mkzAPcbhxHPNPZ4JMbPE28L77x_-q2yX5hjmuhLs Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:01:16.031285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/dd581788f9ca4c2fb1ba3fe02f34b29d"}]}] Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: dd581788f9ca4c2fb1ba3fe02f34b29d Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeTestJSON-954782868 Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: cbb16c0b86444a59ab299013c694cb07 Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeTestJSON-954782868-project Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:16.032610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '62fc001e-fe00-44da-8493-aaf6fc2cd297'} Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:16.033362 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. Aug 31 11:01:16.034613 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:16.035808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:16.035889 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] Returning 404 to user: Instance 62fc001e-fe00-44da-8493-aaf6fc2cd297 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:16.035968 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:16.035968 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:16.036118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-369ccf1b-f871-4f7d-a1f7-f346ad301e68 tempest-AttachVolumeTestJSON-954782868 tempest-AttachVolumeTestJSON-954782868-project] 10.222.0.75 "GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297" status: 404 len: 111 microversion: 2.1 time: 0.030534 Aug 31 11:01:16.036118 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 513/992] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:16 2022] GET /compute/v2.1/servers/62fc001e-fe00-44da-8493-aaf6fc2cd297 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:16.183252 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:16.193948 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6133849b-18c6-4473-846e-4af90bfba4d4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.177073 Aug 31 11:01:16.194519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 480/993] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:16 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:01:16.430596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:16.431178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:16.438818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:16.439317 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:16.439753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:16.440479 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:16.440931 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:16.441359 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:16.788857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:16.797582 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:16.799066 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:16.800284 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-26312bfc-a18e-4857-950e-6ac811f3937d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1671 microversion: 2.20 time: 0.373724 Aug 31 11:01:16.801906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 514/994] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:16 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1671 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:17.215544 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:17.216127 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:17.223040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:17.223533 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:17.223969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:17.224667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:17.225122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:17.225550 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:17.426344 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:17.434588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-98be000c-95ab-4e85-8b35-5853d260203e tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.222851 Aug 31 11:01:17.435393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 481/995] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:17 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:17.823891 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:17.824459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:17.831385 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:17.831913 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:17.832347 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:17.833805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:17.834290 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:17.834712 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:18.057025 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:18.066279 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:18.067725 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:18.068946 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-82ad352f-52f2-4ae0-a19d-55a1636d95a4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1671 microversion: 2.20 time: 0.249155 Aug 31 11:01:18.069478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 515/996] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:17 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:18.120378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1ced56db-ac68-404e-b2d3-93e8ffc81c50 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:18.121288 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1ced56db-ac68-404e-b2d3-93e8ffc81c50 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:18.127860 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ced56db-ac68-404e-b2d3-93e8ffc81c50 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:18.128346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ced56db-ac68-404e-b2d3-93e8ffc81c50 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:18.128780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ced56db-ac68-404e-b2d3-93e8ffc81c50 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:18.129477 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ced56db-ac68-404e-b2d3-93e8ffc81c50 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:18.129965 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ced56db-ac68-404e-b2d3-93e8ffc81c50 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:18.130384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1ced56db-ac68-404e-b2d3-93e8ffc81c50 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:18.155859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1ced56db-ac68-404e-b2d3-93e8ffc81c50 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/ips" status: 200 len: 149 microversion: 2.1 time: 0.039607 Aug 31 11:01:18.163317 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 482/997] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 11:01:18 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:18.459240 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:18.470603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:18.480815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:18.482963 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:18.483641 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:18.484593 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:18.485274 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:18.485960 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:18.735935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:18.747291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-76cf2031-36e7-4573-9d3b-681a18529c25 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.294280 Aug 31 11:01:18.758492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 516/998] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:18 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:19.092355 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:19.092974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:19.100406 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:19.100896 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:19.101382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:19.102064 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:19.102803 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:19.103229 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:19.405651 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:19.414057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:19.415737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:19.417108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-83380f5f-55bb-4c5e-878b-2d258345aec4 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.329348 Aug 31 11:01:19.417840 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 483/999] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:19 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:01:19.752378 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d52d7134-b5a7-45d8-8a46-9c9ff3b78f2c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca64cd6f-8287-432a-9062-35de5bc7da76"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:19.756120 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d52d7134-b5a7-45d8-8a46-9c9ff3b78f2c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:19.771950 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:19.773405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:19.775320 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52d7134-b5a7-45d8-8a46-9c9ff3b78f2c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:19.776393 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52d7134-b5a7-45d8-8a46-9c9ff3b78f2c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:19.777025 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52d7134-b5a7-45d8-8a46-9c9ff3b78f2c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:19.780444 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52d7134-b5a7-45d8-8a46-9c9ff3b78f2c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:19.781129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52d7134-b5a7-45d8-8a46-9c9ff3b78f2c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:19.781813 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d52d7134-b5a7-45d8-8a46-9c9ff3b78f2c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:19.786729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:19.789077 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:19.789678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:19.790281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:19.792180 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:19.793987 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:19.796420 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:20.224468 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:20.233502 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-33f1d656-7c5e-465d-b66a-86bfe786b663 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.467138 Aug 31 11:01:20.234681 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 484/1000] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:19 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:20.293047 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d52d7134-b5a7-45d8-8a46-9c9ff3b78f2c tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "POST /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.552642 Aug 31 11:01:20.294009 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 517/1001] 10.222.0.75 () {60 vars in 1323 bytes} [Wed Aug 31 11:01:19 2022] POST /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:01:20.441070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:20.441684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:20.449404 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:20.455406 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:20.456231 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:20.457221 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:20.458068 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:20.458787 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:20.632302 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:20.641017 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:20.642494 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:20.643708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7d67742d-2e32-4d0b-a77c-b5a68b909376 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.206814 Aug 31 11:01:20.644260 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 485/1002] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:20 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:21.263833 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:21.264614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:21.271545 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:21.272089 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:21.272578 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:21.273312 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:21.273858 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:21.274353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:21.423491 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:21.431801 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-78c51c32-bcfd-4536-a19e-d2a2aa735828 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.172876 Aug 31 11:01:21.432392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 518/1003] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:21 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:21.666655 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:21.667259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:21.674121 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:21.674597 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:21.675217 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:21.675953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:21.676356 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:21.676921 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:22.009512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:22.026472 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:22.029521 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:22.032070 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-624d6089-ff9e-497c-b41d-4dba6005a1e2 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.368535 Aug 31 11:01:22.033385 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 486/1004] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:21 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:22.456107 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:22.457482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:22.465539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:22.466302 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:22.466893 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:22.468257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:22.469111 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:22.469745 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:22.755262 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:22.764700 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b6e5c093-d74f-46e7-b27d-0dfc08f24376 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.314872 Aug 31 11:01:22.765510 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 519/1005] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:22 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:23.072896 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:23.083363 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:23.142011 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:23.147359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:23.164467 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:23.177011 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:23.179825 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:23.180384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:23.595261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:23.610720 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:23.613278 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:23.617424 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-20b70f60-266e-46b8-bd3f-9bcbd4cc621d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.562728 Aug 31 11:01:23.620051 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 487/1006] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:23 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:23.786589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:23.787258 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:23.796133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:23.800786 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:23.801302 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:23.802117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:23.802584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:23.803053 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.106399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:24.114882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-721f9bab-8de9-4953-a88a-bc35792d93c0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1570 microversion: 2.1 time: 0.333440 Aug 31 11:01:24.115460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 520/1007] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:23 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1570 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:24.130756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:24.133719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:24.143358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:24.146955 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.147295 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:24.150364 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.151196 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.152590 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.160171 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.163268 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.169448 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.171489 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.174245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.175628 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.182046 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.183066 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.247000 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120482) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 11:01:24.329859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lazy-loading 'services' on Instance uuid 8003d4a4-75b0-44a7-a188-8048bffe8f07 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:01:24.373540 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c9bd3e25-874a-4986-aac2-e3475a69e357 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "POST /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324/action" status: 202 len: 0 microversion: 2.1 time: 0.240135 Aug 31 11:01:24.378486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 521/1008] 10.222.0.75 () {60 vars in 1278 bytes} [Wed Aug 31 11:01:24 2022] POST /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:01:24.385659 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:24.392295 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:24.421296 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.422412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.422768 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.423506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.423967 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.424670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.483748 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a48ae26f-325a-4762-b57b-9afb7c18f38e tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments/ca64cd6f-8287-432a-9062-35de5bc7da76" status: 202 len: 0 microversion: 2.1 time: 0.355795 Aug 31 11:01:24.490215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 488/1009] 10.222.0.75 () {58 vars in 1416 bytes} [Wed Aug 31 11:01:24 2022] DELETE /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments/ca64cd6f-8287-432a-9062-35de5bc7da76 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:01:24.498298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-143b075b-4635-4a3e-b73c-58b175a8cddc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:24.502596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-143b075b-4635-4a3e-b73c-58b175a8cddc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:24.512011 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-143b075b-4635-4a3e-b73c-58b175a8cddc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.512878 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-143b075b-4635-4a3e-b73c-58b175a8cddc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.514040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-143b075b-4635-4a3e-b73c-58b175a8cddc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.515065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-143b075b-4635-4a3e-b73c-58b175a8cddc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.515813 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-143b075b-4635-4a3e-b73c-58b175a8cddc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.516433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-143b075b-4635-4a3e-b73c-58b175a8cddc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.557994 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-143b075b-4635-4a3e-b73c-58b175a8cddc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065313 Aug 31 11:01:24.558872 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 489/1010] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:24 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:24.648912 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:24.649709 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:24.673985 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.674684 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.675108 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:24.677625 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:24.683339 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:24.684485 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:25.478356 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:25.484539 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:25.492737 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d8a8e1c7-cdd5-4060-9dc7-cf9adcd73bee tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1578 microversion: 2.1 time: 1.112806 Aug 31 11:01:25.495776 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 522/1011] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:24 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1578 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:25.505521 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-916cf0ce-1cfe-416d-a255-95059ef7b62d req-60a51f45-4ed1-4c27-aab5-af0c29fb1c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91b10cf-8d7d-4896-be69-bc4c8089a324", "name": "network-vif-unplugged", "status": "completed", "tag": "5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:25.516690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:25.526113 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:25.528357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f2c145f9-52cd-454c-a734-3f7e0ef68912 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.888069 Aug 31 11:01:25.532129 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 490/1012] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:24 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:25.544477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-916cf0ce-1cfe-416d-a255-95059ef7b62d req-60a51f45-4ed1-4c27-aab5-af0c29fb1c2f service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:25.545024 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-916cf0ce-1cfe-416d-a255-95059ef7b62d req-60a51f45-4ed1-4c27-aab5-af0c29fb1c2f service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:25.545680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-916cf0ce-1cfe-416d-a255-95059ef7b62d req-60a51f45-4ed1-4c27-aab5-af0c29fb1c2f service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:25.571353 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-916cf0ce-1cfe-416d-a255-95059ef7b62d req-60a51f45-4ed1-4c27-aab5-af0c29fb1c2f service nova] Creating event network-vif-unplugged:5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6 for instance c91b10cf-8d7d-4896-be69-bc4c8089a324 on hv-cinder-79578 Aug 31 11:01:25.576704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b46cf89f-b8d7-4041-a4df-5fd7ebff2256 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:25.577316 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-916cf0ce-1cfe-416d-a255-95059ef7b62d req-60a51f45-4ed1-4c27-aab5-af0c29fb1c2f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079673 Aug 31 11:01:25.581933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 523/1013] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:25.589692 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b46cf89f-b8d7-4041-a4df-5fd7ebff2256 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:25.600966 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46cf89f-b8d7-4041-a4df-5fd7ebff2256 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:25.601814 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46cf89f-b8d7-4041-a4df-5fd7ebff2256 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:25.603099 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46cf89f-b8d7-4041-a4df-5fd7ebff2256 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:25.604854 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46cf89f-b8d7-4041-a4df-5fd7ebff2256 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:25.605514 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46cf89f-b8d7-4041-a4df-5fd7ebff2256 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:25.606109 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-b46cf89f-b8d7-4041-a4df-5fd7ebff2256 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:25.647077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b46cf89f-b8d7-4041-a4df-5fd7ebff2256 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079399 Aug 31 11:01:25.648207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 491/1014] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:25 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:26.515451 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:26.516295 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:26.522909 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:26.526094 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:26.526578 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:26.527611 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:26.528267 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:26.528918 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:26.566248 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:26.567581 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:26.577082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:26.578123 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:26.578781 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:26.580111 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:26.581368 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:26.582170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:26.786565 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:26.801358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f7647cc2-acbb-4f42-a393-acc587072063 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1578 microversion: 2.1 time: 0.289439 Aug 31 11:01:26.807439 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 524/1015] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:26 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1578 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:26.812810 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-84e64754-ebc7-475e-9141-356481462b06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:26.822251 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-84e64754-ebc7-475e-9141-356481462b06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:26.841899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84e64754-ebc7-475e-9141-356481462b06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:26.849670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84e64754-ebc7-475e-9141-356481462b06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:26.850675 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84e64754-ebc7-475e-9141-356481462b06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:26.854346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84e64754-ebc7-475e-9141-356481462b06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:26.854968 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84e64754-ebc7-475e-9141-356481462b06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:26.855573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-84e64754-ebc7-475e-9141-356481462b06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:26.914033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:26.923690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:26.925095 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:26.926284 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e89d52e8-4ea8-48d2-96fb-8efd7c21d751 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.370796 Aug 31 11:01:26.926970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 492/1016] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:26 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:26.949337 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-84e64754-ebc7-475e-9141-356481462b06 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140609 Aug 31 11:01:26.950438 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 525/1017] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:26 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:27.832224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:27.833677 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:27.846387 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:27.848519 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:27.850315 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:27.851264 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:27.852305 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:27.855723 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:27.949624 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:27.951492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:27.972638 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:27.973629 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:27.974593 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:27.975746 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:27.976592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:27.977185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:28.093239 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:28.112145 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e2eaf039-fef8-4440-874b-7a526c82bd46 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1578 microversion: 2.1 time: 0.281768 Aug 31 11:01:28.126618 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 493/1018] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:27 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1578 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:28.134730 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-aed1ce66-e98a-471d-816b-03f49308f245 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:28.138110 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-aed1ce66-e98a-471d-816b-03f49308f245 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:28.146997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aed1ce66-e98a-471d-816b-03f49308f245 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:28.148433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aed1ce66-e98a-471d-816b-03f49308f245 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:28.149056 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aed1ce66-e98a-471d-816b-03f49308f245 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:28.151306 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aed1ce66-e98a-471d-816b-03f49308f245 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:28.152651 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aed1ce66-e98a-471d-816b-03f49308f245 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:28.153737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-aed1ce66-e98a-471d-816b-03f49308f245 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:28.257470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-aed1ce66-e98a-471d-816b-03f49308f245 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127713 Aug 31 11:01:28.265320 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 494/1019] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:28 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:28.300533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:28.310037 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:28.317166 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:28.319390 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-11a93d88-c655-43c2-bb42-3707f3b64ab7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.374137 Aug 31 11:01:28.321060 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 526/1020] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:27 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:01:29.136638 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:29.137976 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:29.146729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:29.147497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:29.148055 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:29.148993 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:29.149481 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:29.150012 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:29.275185 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-8c6688a2-c38f-4d35-bee8-6579f618a745 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:29.282144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-8c6688a2-c38f-4d35-bee8-6579f618a745 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:29.297469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8c6688a2-c38f-4d35-bee8-6579f618a745 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:29.298515 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8c6688a2-c38f-4d35-bee8-6579f618a745 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:29.299265 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8c6688a2-c38f-4d35-bee8-6579f618a745 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:29.300159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8c6688a2-c38f-4d35-bee8-6579f618a745 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:29.300818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8c6688a2-c38f-4d35-bee8-6579f618a745 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:29.301665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-8c6688a2-c38f-4d35-bee8-6579f618a745 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:29.348256 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-8c6688a2-c38f-4d35-bee8-6579f618a745 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079146 Aug 31 11:01:29.349592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 527/1021] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:29 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:29.354412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:29.356153 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:29.365432 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:29.366241 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:29.367862 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:29.368798 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:29.370555 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:29.371799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:29.400866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:29.405676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:29.414414 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-15dde770-1b92-4a1d-aa44-847416d6f9f2 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1518 microversion: 2.1 time: 0.281792 Aug 31 11:01:29.415755 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 495/1022] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:29 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1518 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:29.588307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:29.598590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:29.613201 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:29.619172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-20af259d-beb8-4370-8227-83e289f9e76d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.267989 Aug 31 11:01:29.620491 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 528/1023] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:29 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:30.368292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1283645d-f34e-404d-98f1-bd19bdff76b2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:30.376453 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1283645d-f34e-404d-98f1-bd19bdff76b2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:30.395120 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1283645d-f34e-404d-98f1-bd19bdff76b2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:30.395634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1283645d-f34e-404d-98f1-bd19bdff76b2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:30.399594 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1283645d-f34e-404d-98f1-bd19bdff76b2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:30.401561 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1283645d-f34e-404d-98f1-bd19bdff76b2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:30.402081 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1283645d-f34e-404d-98f1-bd19bdff76b2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:30.402983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1283645d-f34e-404d-98f1-bd19bdff76b2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:30.436036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:30.437246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:30.444019 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:30.444589 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:30.445320 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:30.446323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:30.446969 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:30.447504 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:30.448199 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1283645d-f34e-404d-98f1-bd19bdff76b2 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087851 Aug 31 11:01:30.448768 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 496/1024] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:30 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:30.638948 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:30.651634 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:30.652181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:30.652368 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-018d8374-3c78-49c7-bfce-4be54b529121 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1518 microversion: 2.1 time: 0.219817 Aug 31 11:01:30.653101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 529/1025] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:30 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1518 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:01:30.663331 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:30.663880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:30.664259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:30.666158 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:30.666628 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:30.667059 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:30.822661 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:30.831309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:30.836595 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:30.839653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d026c1d9-069a-42b7-9ded-13e1ecc2a986 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.198284 Aug 31 11:01:30.844525 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 497/1026] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:30 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:31.461363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d353bafc-d42b-4ad3-b423-49f94b1622df tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:31.463736 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d353bafc-d42b-4ad3-b423-49f94b1622df tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:31.471538 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d353bafc-d42b-4ad3-b423-49f94b1622df tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:31.472070 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d353bafc-d42b-4ad3-b423-49f94b1622df tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:31.472502 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d353bafc-d42b-4ad3-b423-49f94b1622df tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:31.473674 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d353bafc-d42b-4ad3-b423-49f94b1622df tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:31.474377 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d353bafc-d42b-4ad3-b423-49f94b1622df tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:31.475028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d353bafc-d42b-4ad3-b423-49f94b1622df tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:31.511899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d353bafc-d42b-4ad3-b423-49f94b1622df tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054645 Aug 31 11:01:31.513010 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 530/1027] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:31 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:31.674046 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:31.675210 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:31.682165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:31.682649 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:31.683274 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:31.684068 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:31.684798 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:31.685520 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:31.867171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:31.867924 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:31.874206 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:31.874958 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:31.875463 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:31.876219 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:31.876868 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:31.877348 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:31.885390 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:31.906243 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7f1cb003-96de-4dc4-a8e8-4b9e0baa1cb1 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1518 microversion: 2.1 time: 0.234593 Aug 31 11:01:31.908101 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 498/1028] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:31 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1518 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:32.023831 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:32.032391 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:32.034017 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:32.035402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e945e739-0c6f-404e-9449-f2f0557243e9 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.172808 Aug 31 11:01:32.036188 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 531/1029] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:31 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:01:32.524559 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fced6939-d1ce-4b00-9086-1dc602988269 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:32.526931 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fced6939-d1ce-4b00-9086-1dc602988269 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:32.534135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fced6939-d1ce-4b00-9086-1dc602988269 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:32.534595 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fced6939-d1ce-4b00-9086-1dc602988269 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:32.535030 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fced6939-d1ce-4b00-9086-1dc602988269 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:32.535749 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fced6939-d1ce-4b00-9086-1dc602988269 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:32.536199 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fced6939-d1ce-4b00-9086-1dc602988269 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:32.536621 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fced6939-d1ce-4b00-9086-1dc602988269 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:32.574225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fced6939-d1ce-4b00-9086-1dc602988269 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053513 Aug 31 11:01:32.575446 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 499/1030] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:32 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:32.928051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:32.928803 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:32.935266 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:32.935819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:32.936624 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:32.937310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:32.937752 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:32.938200 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:32.941274 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:33.060550 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:33.062419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:33.075299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:33.075914 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:33.076494 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:33.077216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:33.077447 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:33.078034 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:33.078751 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:33.086627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-29bbcea6-c4f8-46eb-93c1-155f119dc4ec tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1520 microversion: 2.1 time: 0.162516 Aug 31 11:01:33.087544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 532/1031] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:32 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:33.221573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:33.231286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:33.232810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:33.234278 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9bc597db-5539-4c88-b3e3-2cc1e60812b1 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.177613 Aug 31 11:01:33.234848 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 500/1032] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:33 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:01:33.587009 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7cf27700-95ad-4b2d-8e63-6ef37fb147a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:33.589235 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7cf27700-95ad-4b2d-8e63-6ef37fb147a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:33.595577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cf27700-95ad-4b2d-8e63-6ef37fb147a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:33.596062 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cf27700-95ad-4b2d-8e63-6ef37fb147a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:33.596494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cf27700-95ad-4b2d-8e63-6ef37fb147a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:33.597199 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cf27700-95ad-4b2d-8e63-6ef37fb147a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:33.597650 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cf27700-95ad-4b2d-8e63-6ef37fb147a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:33.598110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7cf27700-95ad-4b2d-8e63-6ef37fb147a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:33.628807 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7cf27700-95ad-4b2d-8e63-6ef37fb147a4 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Aug 31 11:01:33.629376 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 533/1033] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:33 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:34.108789 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:34.109508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:34.116448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.116936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.117640 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:34.118400 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.118856 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.119278 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:34.257443 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:34.258641 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:34.266429 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.267180 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.267782 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:34.269008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.269830 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.270672 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:34.274926 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:34.283344 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1996feef-afaf-4ec5-991e-6685358490eb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1520 microversion: 2.1 time: 0.178621 Aug 31 11:01:34.296729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 501/1034] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:34 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:34.440539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:34.450198 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:34.451965 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:34.453977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d3828be3-d7b8-4f76-aa6c-357270e7f8a7 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.199741 Aug 31 11:01:34.453977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 534/1035] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:34 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:01:34.640921 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4fbbfb6e-833e-4d4c-8b01-bcc60529c0e3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:34.643303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4fbbfb6e-833e-4d4c-8b01-bcc60529c0e3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:34.666681 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fbbfb6e-833e-4d4c-8b01-bcc60529c0e3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.667703 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fbbfb6e-833e-4d4c-8b01-bcc60529c0e3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.668159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fbbfb6e-833e-4d4c-8b01-bcc60529c0e3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:34.670671 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fbbfb6e-833e-4d4c-8b01-bcc60529c0e3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.672938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fbbfb6e-833e-4d4c-8b01-bcc60529c0e3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.674252 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4fbbfb6e-833e-4d4c-8b01-bcc60529c0e3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:34.723757 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4fbbfb6e-833e-4d4c-8b01-bcc60529c0e3 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086994 Aug 31 11:01:34.724325 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 502/1036] 10.222.0.75 () {58 vars in 1302 bytes} [Wed Aug 31 11:01:34 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 11:01:34.795764 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:34.796445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:34.802821 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.803512 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.804184 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:34.805048 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.805665 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.806110 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:34.834804 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:01:34.928350 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-4921d33d-58fb-4ecf-a2ba-9af2030d54d5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 204 len: 0 microversion: 2.1 time: 0.136887 Aug 31 11:01:34.929637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 535/1037] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:01:34 2022] DELETE /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:01:34.939173 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:34.939799 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:34.945880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.946374 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.946810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:34.947512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:34.947967 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:34.948388 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:35.156040 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:35.163925 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-924bcdef-df2e-4b9e-9efa-77e2abe7e439 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1681 microversion: 2.1 time: 0.229666 Aug 31 11:01:35.164625 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 503/1038] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:34 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:35.305017 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:35.306105 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:35.318392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:35.318914 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:35.319431 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:35.320088 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:35.320556 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:35.320946 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:35.481154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:35.481760 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:35.489849 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:35.490583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:35.491016 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:35.491807 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:35.492255 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:35.492668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:35.495682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:35.504293 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-24ed7f4c-73ec-4c04-ab00-9b0e6fa07ea0 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.203543 Aug 31 11:01:35.505273 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 536/1039] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:35 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:35.660582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:35.670100 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:35.671650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:35.673257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ea200ddd-4077-43d9-91b3-b1dc75043014 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.197424 Aug 31 11:01:35.673582 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 504/1040] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:35 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:36.187986 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:36.188938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:36.195927 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:36.197080 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:36.197541 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:36.198340 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:36.198803 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:36.199271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:36.424758 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:36.434101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-aeeed998-accf-40ef-9a19-fd9591c5de09 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1681 microversion: 2.1 time: 0.250960 Aug 31 11:01:36.434984 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 537/1041] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:36 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:36.526610 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:36.528924 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:36.547754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:36.548282 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:36.548784 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:36.551209 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:36.551756 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:36.553856 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:36.703777 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:36.704926 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:36.711935 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:36.712727 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:36.713363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:36.714671 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:36.715386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:36.716060 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:36.753973 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:36.767292 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3d1ed025-03a2-477c-be2a-6664d002a65d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.244526 Aug 31 11:01:36.767895 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 505/1042] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:36 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:36.784730 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-6208d99a-a67a-4aa1-8fc1-6414844c175a req-7b31ec47-4739-42b9-8e00-2e63396b7980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd1f4b3-b876-4694-879d-791fb851a085", "name": "network-vif-plugged", "status": "completed", "tag": "13802481-258c-4015-b25a-d35749ab72e3"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:36.798601 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-6208d99a-a67a-4aa1-8fc1-6414844c175a req-7b31ec47-4739-42b9-8e00-2e63396b7980 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:36.799390 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-6208d99a-a67a-4aa1-8fc1-6414844c175a req-7b31ec47-4739-42b9-8e00-2e63396b7980 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:36.800057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-6208d99a-a67a-4aa1-8fc1-6414844c175a req-7b31ec47-4739-42b9-8e00-2e63396b7980 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:36.821810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-6208d99a-a67a-4aa1-8fc1-6414844c175a req-7b31ec47-4739-42b9-8e00-2e63396b7980 service nova] Creating event network-vif-plugged:13802481-258c-4015-b25a-d35749ab72e3 for instance 1cd1f4b3-b876-4694-879d-791fb851a085 on hv-cinder-79578 Aug 31 11:01:36.832407 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-6208d99a-a67a-4aa1-8fc1-6414844c175a req-7b31ec47-4739-42b9-8e00-2e63396b7980 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062072 Aug 31 11:01:36.833031 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 506/1043] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:37.206178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:37.222153 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:37.226465 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:37.228263 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-58293393-f47e-40d5-b238-8db34473ae14 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.529297 Aug 31 11:01:37.229331 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 538/1044] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:36 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:37.464630 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:37.465677 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:37.481221 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:37.482310 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:37.482820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:37.483796 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:37.484398 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:37.485014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:37.788559 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:37.789135 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:37.795218 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:37.795766 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:37.796200 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:37.796898 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:37.797358 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:37.797799 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:37.819153 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:37.829576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-5efe40cf-2baf-41c0-a5ec-71b78681ddcc tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1681 microversion: 2.1 time: 0.373958 Aug 31 11:01:37.830686 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 507/1045] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:37 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1681 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:38.065790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:38.074709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-873942fa-9b91-45ce-b800-22ddec2ce3fc tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.290018 Aug 31 11:01:38.075510 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 539/1046] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:37 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:01:38.254081 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:38.255091 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:38.261763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:38.262342 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:38.263047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:38.264293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:38.265304 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:38.266154 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:38.674629 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:38.685204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:38.687350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:38.688556 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-03e886c4-175c-41e3-875a-551e733e5133 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.440932 Aug 31 11:01:38.689476 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 508/1047] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:38 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:38.854642 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:38.855384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:38.866916 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:38.867718 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:38.868224 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-aa984af2-2c87-4a98-8b0f-1b881877eaf3 req-6f2ab8ea-7fde-4abc-9600-c7fa025f6d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8003d4a4-75b0-44a7-a188-8048bffe8f07", "name": "network-vif-deleted", "tag": "d56b8227-5700-4106-8ac8-377944ae1f75"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:38.868991 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:38.869964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:38.870698 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:38.871314 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:38.888081 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-aa984af2-2c87-4a98-8b0f-1b881877eaf3 req-6f2ab8ea-7fde-4abc-9600-c7fa025f6d74 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:38.889014 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-aa984af2-2c87-4a98-8b0f-1b881877eaf3 req-6f2ab8ea-7fde-4abc-9600-c7fa025f6d74 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:38.889496 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-aa984af2-2c87-4a98-8b0f-1b881877eaf3 req-6f2ab8ea-7fde-4abc-9600-c7fa025f6d74 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:38.906483 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-aa984af2-2c87-4a98-8b0f-1b881877eaf3 req-6f2ab8ea-7fde-4abc-9600-c7fa025f6d74 service nova] Creating event network-vif-deleted:d56b8227-5700-4106-8ac8-377944ae1f75 for instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 on hv-cinder-79578 Aug 31 11:01:38.912718 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-aa984af2-2c87-4a98-8b0f-1b881877eaf3 req-6f2ab8ea-7fde-4abc-9600-c7fa025f6d74 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048326 Aug 31 11:01:38.913928 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 509/1048] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:01:38.965368 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:38.974311 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5ae54645-4740-48bf-8bea-5950ca9dd797 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1613 microversion: 2.1 time: 0.126799 Aug 31 11:01:38.975218 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 540/1049] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:38 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1613 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:39.097369 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:39.098441 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:39.105537 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:39.106677 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:39.107269 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:39.108309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:39.109003 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:39.109593 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:39.270244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:39.291741 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fe3ff504-5be0-4de8-b0f2-b062e4f45768 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.199382 Aug 31 11:01:39.293216 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 510/1050] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:39 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:39.712976 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:39.713658 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:39.726316 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:39.726898 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:39.727465 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:39.728820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:39.729597 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:39.730119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:39.904214 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:39.917415 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:39.919722 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:39.922324 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b7e20c64-ca7d-4e19-8412-2509dea8c93d tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1729 microversion: 2.20 time: 0.213944 Aug 31 11:01:39.923286 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 541/1051] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:39 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:39.996879 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:39.997574 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:40.005821 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:40.006583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:40.007309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:40.008382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:40.009005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:40.009962 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:40.059772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:40.060319 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:40.060935 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:40.061786 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.objects.instance [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lazy-loading 'fault' on Instance uuid 8003d4a4-75b0-44a7-a188-8048bffe8f07 {{(pid=120481) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 11:01:40.142082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f1b9e32ad3493284c5df45afd042fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c3039f002ef448b99d4e7f484055fd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:40.151889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d5737f34-50c5-4f0d-9cf4-a5c6651a9f0b tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 200 len: 1331 microversion: 2.1 time: 0.158684 Aug 31 11:01:40.155950 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 511/1052] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:39 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 1331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:40.317578 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:40.318221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:40.326551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:40.327189 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:40.328178 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:40.329869 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:40.330847 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:40.331698 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:40.473943 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:40.481901 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0a4c477b-631c-490b-bb9f-623e5b1a6ca4 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.168424 Aug 31 11:01:40.482614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 542/1053] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:40 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:40.946371 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:40.946996 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:40.953027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:40.953513 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:40.953998 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:40.954653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:40.955103 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:40.955531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:41.102155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:41.111534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:41.113261 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:41.114662 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bdd15af1-d6ad-4e19-b6cd-8e0086253e8c tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1716 microversion: 2.20 time: 0.172272 Aug 31 11:01:41.115321 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 512/1054] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:01:40 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1716 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:01:41.178086 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:41.178646 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:41.182603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:41.194245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:41.194245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:41.194245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:41.194245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:41.194592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:41.194592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:41.212411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 HTTP/1.1 Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:01:41.214090 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:41.215757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '8003d4a4-75b0-44a7-a188-8048bffe8f07'} Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:41.216791 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:41.218407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:41.219741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:41.219741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-56c0a947-fce3-46e3-a874-f47e0b78c823 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 404 len: 111 microversion: 2.1 time: 0.041475 Aug 31 11:01:41.219741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 543/1055] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:41 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:41.224825 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bc290a4d-43b0-47d3-988b-9f510f1141c5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '.version_select at 0x7f37a8cb9c10>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:41.245383 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bc290a4d-43b0-47d3-988b-9f510f1141c5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795349576" status: 202 len: 0 microversion: 2.1 time: 0.024380 Aug 31 11:01:41.246002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 513/1056] 10.222.0.75 () {58 vars in 1221 bytes} [Wed Aug 31 11:01:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1795349576 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:01:41.503702 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:41.504234 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:41.511150 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:41.511543 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:41.511975 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:41.512720 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:41.513186 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:41.513592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:41.665506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:41.674132 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-61ed1a31-6591-40e0-bb16-f9ada338dc8a tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.174790 Aug 31 11:01:41.674820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 544/1057] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:41 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:42.696448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:42.700354 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:42.705363 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:42.705892 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:42.706492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:42.707361 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:42.707840 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:42.708424 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:42.724710 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=100 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:42.866706 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:42.875907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9365c151-941e-4757-b44a-6f879126e665 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.183618 Aug 31 11:01:42.877033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 514/1058] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:42 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:43.052420 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:43.053544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:43.062845 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:43.063614 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:43.064439 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:43.065389 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:43.066078 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:43.066717 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:43.083600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: DELETE /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 HTTP/1.1 Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:01:43.086603 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.088221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '8003d4a4-75b0-44a7-a188-8048bffe8f07'} Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:43.089341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.090625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.093231 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:43.093231 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7aa898b8-1037-438b-b553-61e21e4875db tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 404 len: 111 microversion: 2.1 time: 0.041856 Aug 31 11:01:43.093231 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 545/1059] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:01:43 2022] DELETE /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:43.100225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:43.100844 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 8003d4a4-75b0-44a7-a188-8048bffe8f07] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:43.110148 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:43.110859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:43.111601 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:43.112536 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:43.113183 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:43.113813 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:43.128258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 HTTP/1.1 Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:01:43.130155 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.131545 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '8003d4a4-75b0-44a7-a188-8048bffe8f07'} Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:43.132322 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. Aug 31 11:01:43.133548 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:43.135972 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance 8003d4a4-75b0-44a7-a188-8048bffe8f07 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:43.137021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-67cc61ad-c88d-4042-846e-ab60d59df063 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07" status: 404 len: 111 microversion: 2.1 time: 0.040805 Aug 31 11:01:43.137819 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 515/1060] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:43 2022] GET /compute/v2.1/servers/8003d4a4-75b0-44a7-a188-8048bffe8f07 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:43.898171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:43.898952 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:43.905287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:43.905796 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:43.906238 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:43.906952 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:43.907379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:43.907794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:44.041244 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:44.049648 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cb4f8a0d-4537-4050-89f3-d82242f58686 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.155677 Aug 31 11:01:44.050233 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 546/1061] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:43 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:44.293797 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:44.294337 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:44.301544 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:44.302080 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:44.302517 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:44.303382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:44.303997 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:44.304589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:44.319874 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: DELETE /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 HTTP/1.1 Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:01:44.321475 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.323238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'cb34b296-2951-4f41-be97-703d0d35dfe4'} Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:44.324130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.325719 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.327297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:44.327297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9daaaaeb-3494-488e-af05-3aa77b56a4bd tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 404 len: 111 microversion: 2.1 time: 0.033478 Aug 31 11:01:44.327297 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 516/1062] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:01:44 2022] DELETE /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:44.336685 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:44.336685 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: cb34b296-2951-4f41-be97-703d0d35dfe4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:44.341145 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:44.342006 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:44.342442 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:44.343213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:44.343763 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:44.344097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:44.359323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 HTTP/1.1 Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:01:44.361044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.362596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'cb34b296-2951-4f41-be97-703d0d35dfe4'} Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:44.363470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. Aug 31 11:01:44.364906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.366200 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance cb34b296-2951-4f41-be97-703d0d35dfe4 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:44.366200 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6c6ae741-0f47-4899-bfcd-bf498b068c78 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4" status: 404 len: 111 microversion: 2.1 time: 0.033953 Aug 31 11:01:44.366200 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 547/1063] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:44 2022] GET /compute/v2.1/servers/cb34b296-2951-4f41-be97-703d0d35dfe4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:44.372092 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:44.372730 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:44.379203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:44.379658 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:44.380082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:44.380784 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:44.381240 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:44.381664 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:44.396274 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: DELETE /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 HTTP/1.1 Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:01:44.397873 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.399303 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'e849d954-3d1f-494d-8394-f6ec1dba55c4'} Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:44.400159 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.401348 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.402645 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:44.406564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-71b17037-94a1-41d5-80a4-458e6a1935a5 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 404 len: 111 microversion: 2.1 time: 0.038434 Aug 31 11:01:44.407246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 517/1064] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:01:44 2022] DELETE /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:44.415472 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:44.418570 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: e849d954-3d1f-494d-8394-f6ec1dba55c4] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:44.427788 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:44.428505 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:44.429149 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:44.430202 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:44.430862 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:44.431336 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:44.450585 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 HTTP/1.1 Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:01:44.452421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.453852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'e849d954-3d1f-494d-8394-f6ec1dba55c4'} Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:44.454609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. Aug 31 11:01:44.455949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:44.458205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance e849d954-3d1f-494d-8394-f6ec1dba55c4 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:44.459072 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a0117070-4eae-49c5-8728-9b8237848756 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4" status: 404 len: 111 microversion: 2.1 time: 0.047732 Aug 31 11:01:44.459649 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 548/1065] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:44 2022] GET /compute/v2.1/servers/e849d954-3d1f-494d-8394-f6ec1dba55c4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:45.071656 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:45.072189 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:45.078294 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:45.078773 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:45.079206 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:45.079896 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:45.080342 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:45.080771 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:45.221448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:45.230034 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-2558c5a4-a390-43ef-8fe3-5c52af1bc5a8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.162292 Aug 31 11:01:45.230605 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 518/1066] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:45 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:45.615920 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:45.616449 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:45.623275 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:45.623758 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:45.624399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:45.625099 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:45.625551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:45.626000 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:45.640152 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: DELETE /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 HTTP/1.1 Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:01:45.641820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.643460 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '62cc77f5-17ed-46dc-bc9f-a927415fc639'} Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:45.644373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.645938 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.648246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:45.648246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a14fd4b7-6c6c-4007-9d4c-a97fc2b0f843 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "DELETE /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 404 len: 111 microversion: 2.1 time: 0.031598 Aug 31 11:01:45.648246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 549/1067] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:01:45 2022] DELETE /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:45.652676 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:45.653299 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] [instance: 62cc77f5-17ed-46dc-bc9f-a927415fc639] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:45.660024 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:45.660802 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:45.660943 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:45.661870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:45.662338 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:45.662766 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:45.677994 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] HTTP exception thrown: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Request method failure captured: Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 HTTP/1.1 Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz3d97m_dnx2cNrrMY5ZFhFwIFYTdolN-vbmr-I-nqTqKpCos5C5UZMSL4VviOOIkLdEMFbBVDuIqZTPkfJEH_Dk-9hmQ5J_AMwcbSkYrKLESGrnNw5opw5InLO_QaaKOv7k-i0-E9BycOQ9uL3jf_3fY3BimZIYFO92D73FjUehZ54 Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:01:45.679565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/7c3039f002ef448b99d4e7f484055fd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/7c3039f002ef448b99d4e7f484055fd7"}]}] Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 7c3039f002ef448b99d4e7f484055fd7 Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-222261621 Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 73f1b9e32ad3493284c5df45afd042fa Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeNegativeTest-222261621-project Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.681077 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '62cc77f5-17ed-46dc-bc9f-a927415fc639'} Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:01:45.682328 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. Aug 31 11:01:45.683855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:01:45.685281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] Returning 404 to user: Instance 62cc77f5-17ed-46dc-bc9f-a927415fc639 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:01:45.685281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c8ebce09-52ff-4bdd-b9d9-4cfe2a6315f8 tempest-AttachVolumeNegativeTest-222261621 tempest-AttachVolumeNegativeTest-222261621-project] 10.222.0.75 "GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639" status: 404 len: 111 microversion: 2.1 time: 0.032417 Aug 31 11:01:45.685281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 519/1068] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:45 2022] GET /compute/v2.1/servers/62cc77f5-17ed-46dc-bc9f-a927415fc639 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:01:46.251119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:46.251729 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:46.258355 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:46.258844 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:46.259271 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:46.259970 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:46.260451 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:46.260827 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:46.279006 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:46.404310 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:46.412762 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6156ef77-8a3a-4925-98c5-404546189ca9 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.165754 Aug 31 11:01:46.413580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 550/1069] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:46 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:47.435675 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:47.436536 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:47.443868 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:47.463325 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:47.465035 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:47.465823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:47.467375 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:47.468568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:47.469463 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:47.703264 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:47.712357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-20563db6-82ef-42e8-9dd3-d81dde2ed401 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.281146 Aug 31 11:01:47.713214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 520/1070] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:47 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:01:48.734369 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:48.734969 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:48.751018 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:48.751548 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:48.752182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:48.754830 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:48.755478 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:48.755910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:48.935122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-4951fdd8-953b-4200-8ab3-6e8dc6cf0a51 req-d23fafae-8db2-43c1-b64b-8ef3ace57055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91b10cf-8d7d-4896-be69-bc4c8089a324", "name": "network-vif-plugged", "status": "completed", "tag": "5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:01:48.952118 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-4951fdd8-953b-4200-8ab3-6e8dc6cf0a51 req-d23fafae-8db2-43c1-b64b-8ef3ace57055 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:48.952603 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-4951fdd8-953b-4200-8ab3-6e8dc6cf0a51 req-d23fafae-8db2-43c1-b64b-8ef3ace57055 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:48.953024 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-4951fdd8-953b-4200-8ab3-6e8dc6cf0a51 req-d23fafae-8db2-43c1-b64b-8ef3ace57055 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:48.973672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-4951fdd8-953b-4200-8ab3-6e8dc6cf0a51 req-d23fafae-8db2-43c1-b64b-8ef3ace57055 service nova] Creating event network-vif-plugged:5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6 for instance c91b10cf-8d7d-4896-be69-bc4c8089a324 on hv-cinder-79578 Aug 31 11:01:48.992050 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-4951fdd8-953b-4200-8ab3-6e8dc6cf0a51 req-d23fafae-8db2-43c1-b64b-8ef3ace57055 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060875 Aug 31 11:01:48.993974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 521/1071] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:01:49.272467 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:49.286696 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-577d5ef8-b7f6-4475-b339-78273c98d615 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.556611 Aug 31 11:01:49.292532 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 551/1072] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:48 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:50.315169 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:50.316713 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:50.325124 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:50.325611 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:50.326113 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:50.327053 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:50.328191 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:50.328773 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:50.493079 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:50.500999 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c4bcf8de-b261-4082-902b-1a5853acb8e8 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1576 microversion: 2.1 time: 0.192147 Aug 31 11:01:50.501562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 522/1073] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:50 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:01:51.522726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:01:51.523413 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:01:51.530753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:51.531409 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:51.531701 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:51.532444 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:01:51.536225 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:01:51.536712 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:01:51.693843 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:01:51.701958 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b40a6456-915c-4c9f-93a6-fa328dab38bb tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1563 microversion: 2.1 time: 0.184362 Aug 31 11:01:51.714098 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 552/1074] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:01:51 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:02:23.688193 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3e98148d-e8c6-44c7-958f-45dd29511265 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:23.691974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3e98148d-e8c6-44c7-958f-45dd29511265 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:23.698908 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=5 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:23.700233 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=31 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:23.702264 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e98148d-e8c6-44c7-958f-45dd29511265 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:23.703002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e98148d-e8c6-44c7-958f-45dd29511265 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:23.703917 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e98148d-e8c6-44c7-958f-45dd29511265 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:23.704932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e98148d-e8c6-44c7-958f-45dd29511265 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:23.705602 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e98148d-e8c6-44c7-958f-45dd29511265 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:23.706448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3e98148d-e8c6-44c7-958f-45dd29511265 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:23.744139 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3e98148d-e8c6-44c7-958f-45dd29511265 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.061441 Aug 31 11:02:23.745417 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 523/1075] 10.222.0.75 () {60 vars in 1343 bytes} [Wed Aug 31 11:02:23 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:02:23.816083 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:23.817413 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:23.821760 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=19 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:23.822738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=15 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:23.829245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:23.830256 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:23.830934 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:23.834135 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:23.834834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:23.835695 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:23.871220 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:02:23.979252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-bd78819b-1338-4d4b-be9e-eefc6b37e628 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 204 len: 0 microversion: 2.20 time: 0.167747 Aug 31 11:02:23.979853 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 553/1076] 10.222.0.75 () {60 vars in 1280 bytes} [Wed Aug 31 11:02:23 2022] DELETE /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 11:02:23.989747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:23.991452 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:24.000517 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:24.001064 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:24.001501 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:24.002246 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:24.002700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:24.003126 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:24.159458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:24.167963 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:24.169748 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:24.170980 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f95fcd5b-4650-4bee-8108-6a6e15e1344a tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.185995 Aug 31 11:02:24.171532 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 524/1077] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:02:23 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 11:02:25.195826 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:25.196555 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:25.203091 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:25.203581 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:25.204021 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:25.204723 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:25.205218 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:25.205639 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:25.360044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:25.368184 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:25.369670 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:25.370897 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5ed63b8b-043c-467b-ae8d-d5e4dd1ba671 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1722 microversion: 2.20 time: 0.179741 Aug 31 11:02:25.371459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 554/1078] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:02:25 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:02:26.396002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:26.396665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:26.405725 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:26.422823 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:26.423720 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:26.426399 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:26.427665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:26.428376 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:26.609450 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:26.625181 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:26.632153 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324325d907f244beb6862df4116f2c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81fc613102504ca1a7f12a1fceb2ed51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:26.636180 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-24c59061-3134-478c-a21e-13c7e0cb1aff tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 200 len: 1655 microversion: 2.20 time: 0.245581 Aug 31 11:02:26.639466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 525/1079] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:02:26 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 1655 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 11:02:26.883865 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-cdaf0f73-ef32-4d9c-8751-a83cfe1c7c1c req-08ac3636-6fee-4874-998f-6ad5539fa8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd1f4b3-b876-4694-879d-791fb851a085", "name": "network-vif-deleted", "tag": "13802481-258c-4015-b25a-d35749ab72e3"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:02:26.895161 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-cdaf0f73-ef32-4d9c-8751-a83cfe1c7c1c req-08ac3636-6fee-4874-998f-6ad5539fa8f1 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:26.895744 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-cdaf0f73-ef32-4d9c-8751-a83cfe1c7c1c req-08ac3636-6fee-4874-998f-6ad5539fa8f1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:26.896247 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-cdaf0f73-ef32-4d9c-8751-a83cfe1c7c1c req-08ac3636-6fee-4874-998f-6ad5539fa8f1 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:26.916972 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-cdaf0f73-ef32-4d9c-8751-a83cfe1c7c1c req-08ac3636-6fee-4874-998f-6ad5539fa8f1 service nova] Creating event network-vif-deleted:13802481-258c-4015-b25a-d35749ab72e3 for instance 1cd1f4b3-b876-4694-879d-791fb851a085 on hv-cinder-79578 Aug 31 11:02:26.925657 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-cdaf0f73-ef32-4d9c-8751-a83cfe1c7c1c req-08ac3636-6fee-4874-998f-6ad5539fa8f1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042443 Aug 31 11:02:26.926725 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 555/1080] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:27.662442 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:27.663117 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:27.688306 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:27.693614 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:27.695442 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:27.696397 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:27.697750 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:27.698466 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:27.744449 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] HTTP exception thrown: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Request method failure captured: Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 HTTP/1.1 Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz4pLQDeZpE76epTiBTvXFBXGkH8xNxsmjRBcstQ5Jx8gPMXvM6uMvNxtmLrppsDA2U6NCYliPxgizYUhtoPDC4rHN0R9hiYKMWxbOBA7FQv-HDxqQMVUzHcT9l9lgA-JZMXEBZxU8estGcYC8NRmyXcRydZFhsWK0H2uZuo7RpmM5Y Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:02:27.754207 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/81fc613102504ca1a7f12a1fceb2ed51"}]}] Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 324325d907f244beb6862df4116f2c78 Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:27.756023 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '1cd1f4b3-b876-4694-879d-791fb851a085'} Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:27.757008 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:27.758667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:27.761658 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Returning 404 to user: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:27.764568 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6fbad86b-9258-4e9e-9ca4-d8089f229b6b tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 404 len: 111 microversion: 2.20 time: 0.106501 Aug 31 11:02:27.766642 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 526/1081] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:02:27 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:02:27.776323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-405513f1-1960-43a6-8285-b3fe841c4d03 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '.version_select at 0x7f37a8a331f0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:27.815598 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-405513f1-1960-43a6-8285-b3fe841c4d03 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002983382" status: 204 len: 0 microversion: 2.20 time: 0.043614 Aug 31 11:02:27.816609 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 556/1082] 10.222.0.75 () {60 vars in 1262 bytes} [Wed Aug 31 11:02:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1002983382 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 11:02:30.214626 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:30.215107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:30.231562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:30.232258 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:30.232869 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:30.233808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:30.234957 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:30.235917 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:30.251833 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] HTTP exception thrown: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Request method failure captured: Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: DELETE /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 HTTP/1.1 Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz4pLQDeZpE76epTiBTvXFBXGkH8xNxsmjRBcstQ5Jx8gPMXvM6uMvNxtmLrppsDA2U6NCYliPxgizYUhtoPDC4rHN0R9hiYKMWxbOBA7FQv-HDxqQMVUzHcT9l9lgA-JZMXEBZxU8estGcYC8NRmyXcRydZFhsWK0H2uZuo7RpmM5Y Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:02:30.253454 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/81fc613102504ca1a7f12a1fceb2ed51"}]}] Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 324325d907f244beb6862df4116f2c78 Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.255225 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '1cd1f4b3-b876-4694-879d-791fb851a085'} Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:30.256170 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.257668 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.259206 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Returning 404 to user: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:30.259206 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-de9fd0c1-be5e-4ed6-939d-d62b0b48eb02 tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 404 len: 111 microversion: 2.20 time: 0.044361 Aug 31 11:02:30.263785 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:30.264531 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: 1cd1f4b3-b876-4694-879d-791fb851a085] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:30.269566 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 527/1083] 10.222.0.75 () {60 vars in 1280 bytes} [Wed Aug 31 11:02:30 2022] DELETE /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:02:30.272127 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:30.272615 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:30.273044 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:30.273753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:30.274232 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:30.274654 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:30.289805 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] HTTP exception thrown: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Request method failure captured: Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 HTTP/1.1 Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz4pLQDeZpE76epTiBTvXFBXGkH8xNxsmjRBcstQ5Jx8gPMXvM6uMvNxtmLrppsDA2U6NCYliPxgizYUhtoPDC4rHN0R9hiYKMWxbOBA7FQv-HDxqQMVUzHcT9l9lgA-JZMXEBZxU8estGcYC8NRmyXcRydZFhsWK0H2uZuo7RpmM5Y Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:02:30.292459 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/81fc613102504ca1a7f12a1fceb2ed51"}]}] Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 324325d907f244beb6862df4116f2c78 Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.294246 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '1cd1f4b3-b876-4694-879d-791fb851a085'} Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:30.295082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. Aug 31 11:02:30.296450 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:30.297632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Returning 404 to user: Instance 1cd1f4b3-b876-4694-879d-791fb851a085 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:30.297632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-742e34fd-b5ef-45cd-ac35-40ec11699c0f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085" status: 404 len: 111 microversion: 2.20 time: 0.034176 Aug 31 11:02:30.297632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 557/1084] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:02:30 2022] GET /compute/v2.1/servers/1cd1f4b3-b876-4694-879d-791fb851a085 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:02:31.459300 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:31.460452 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:31.468007 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:31.468763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:31.469448 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:31.470495 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:31.471120 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:31.471707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:31.494432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] HTTP exception thrown: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Request method failure captured: Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: DELETE /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 HTTP/1.1 Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz4pLQDeZpE76epTiBTvXFBXGkH8xNxsmjRBcstQ5Jx8gPMXvM6uMvNxtmLrppsDA2U6NCYliPxgizYUhtoPDC4rHN0R9hiYKMWxbOBA7FQv-HDxqQMVUzHcT9l9lgA-JZMXEBZxU8estGcYC8NRmyXcRydZFhsWK0H2uZuo7RpmM5Y Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:02:31.496527 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/81fc613102504ca1a7f12a1fceb2ed51"}]}] Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 324325d907f244beb6862df4116f2c78 Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.498350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'a8fdb0f3-110c-4250-8dcc-e44426464c66'} Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:31.499285 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.500808 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.503754 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Returning 404 to user: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:31.505065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-51d5ba04-e40c-46ce-8a83-2302ac961acc tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "DELETE /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 404 len: 111 microversion: 2.20 time: 0.049791 Aug 31 11:02:31.506044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 528/1085] 10.222.0.75 () {60 vars in 1280 bytes} [Wed Aug 31 11:02:31 2022] DELETE /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:02:31.517441 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:31.518332 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] [instance: a8fdb0f3-110c-4250-8dcc-e44426464c66] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:31.526537 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:31.527033 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:31.527724 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:31.528451 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:31.528957 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:31.529869 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:31.569951 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] HTTP exception thrown: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Request method failure captured: Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 HTTP/1.1 Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz4pLQDeZpE76epTiBTvXFBXGkH8xNxsmjRBcstQ5Jx8gPMXvM6uMvNxtmLrppsDA2U6NCYliPxgizYUhtoPDC4rHN0R9hiYKMWxbOBA7FQv-HDxqQMVUzHcT9l9lgA-JZMXEBZxU8estGcYC8NRmyXcRydZFhsWK0H2uZuo7RpmM5Y Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:02:31.572600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/81fc613102504ca1a7f12a1fceb2ed51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/81fc613102504ca1a7f12a1fceb2ed51"}]}] Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 81fc613102504ca1a7f12a1fceb2ed51 Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1663340506 Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 324325d907f244beb6862df4116f2c78 Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1663340506-project Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.574386 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'a8fdb0f3-110c-4250-8dcc-e44426464c66'} Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:31.575291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. Aug 31 11:02:31.576792 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:31.578186 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] Returning 404 to user: Instance a8fdb0f3-110c-4250-8dcc-e44426464c66 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:31.578186 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-73a6105c-7539-4dfa-b7f3-2ec536c6708f tempest-AttachVolumeShelveTestJSON-1663340506 tempest-AttachVolumeShelveTestJSON-1663340506-project] 10.222.0.75 "GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66" status: 404 len: 111 microversion: 2.20 time: 0.064511 Aug 31 11:02:31.580784 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 558/1086] 10.222.0.75 () {60 vars in 1277 bytes} [Wed Aug 31 11:02:31 2022] GET /compute/v2.1/servers/a8fdb0f3-110c-4250-8dcc-e44426464c66 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:02:32.936076 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-38b856b2-8709-4a63-b416-0ea3f3894f5f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Action: 'create', calling method: .version_select at 0x7f37a8cce550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1207752644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrlQq3qjhokQM+1JX4fuEFgNAk76qh6YWnF/xmO5MSMeLscr4bogeuwJ/fh9nikiIqd6j6hkKAtk1KoJy0O8s2JP36xTC5S4sLaZ2Yh6VehFsybU4bwrRRlOpA5gXq49g=="}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:02:32.953534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-38b856b2-8709-4a63-b416-0ea3f3894f5f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Getting quotas for project fdd5d77d519c46689286cec82a24d9b7. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:02:32.958395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.quota [None req-38b856b2-8709-4a63-b416-0ea3f3894f5f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Getting quotas for user 951b4d24f5c4460db22218f94ded0c57 and project fdd5d77d519c46689286cec82a24d9b7. Resources: {'key_pairs'} {{(pid=120481) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:02:32.988704 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-38b856b2-8709-4a63-b416-0ea3f3894f5f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.566082 Aug 31 11:02:32.989446 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 529/1087] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Aug 31 11:02:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:37.720822 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-c6831a7e-c60f-40c0-8ba8-3f0330e8bffb tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Action: 'create', calling method: .version_select at 0x7f37a8c1db80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-169317189"}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:02:38.048596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-c6831a7e-c60f-40c0-8ba8-3f0330e8bffb tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.458238 Aug 31 11:02:38.049313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 559/1088] 10.222.0.75 () {60 vars in 1155 bytes} [Wed Aug 31 11:02:37 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 460 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 11:02:38.063172 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1715d706-397b-4d7b-83a5-8fd175dca715 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8cb9e50>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:38.135735 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1715d706-397b-4d7b-83a5-8fd175dca715 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae" status: 200 len: 344 microversion: 2.1 time: 0.078009 Aug 31 11:02:38.136534 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 530/1089] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 11:02:38 2022] GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:39.158461 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5260f978-fcb1-4d2b-851e-6f9bef1afc84 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8e1b430>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:39.226496 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5260f978-fcb1-4d2b-851e-6f9bef1afc84 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae" status: 200 len: 345 microversion: 2.1 time: 0.079406 Aug 31 11:02:39.227130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 560/1090] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 11:02:39 2022] GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:39.240649 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-505f7b74-a0d2-420f-8ee1-37274eb7b046 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Action: 'create', calling method: .version_select at 0x7f37a8d1db80>, body: {"snapshot": {"volume_id": "30b73db9-c818-40ba-8121-1843e8681fae", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2065045758"}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:02:39.436351 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-505f7b74-a0d2-420f-8ee1-37274eb7b046 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.200093 Aug 31 11:02:39.436891 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 531/1091] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Aug 31 11:02:39 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:39.449743 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-dc182b99-0680-4e69-8d23-707f4963fde7 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8db8160>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:39.486820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-dc182b99-0680-4e69-8d23-707f4963fde7 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493" status: 200 len: 287 microversion: 2.1 time: 0.042119 Aug 31 11:02:39.487406 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 561/1092] 10.222.0.75 () {58 vars in 1251 bytes} [Wed Aug 31 11:02:39 2022] GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:39.499522 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4b631a60-4d5a-478a-af7d-5154358908e2 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8b90940>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:39.533537 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4b631a60-4d5a-478a-af7d-5154358908e2 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037950 Aug 31 11:02:39.541036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 532/1093] 10.222.0.75 () {58 vars in 1140 bytes} [Wed Aug 31 11:02:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:39.546255 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9fa0bcf4-da8c-400a-8cac-e712e31f375d tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8c1db80>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:39.578921 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9fa0bcf4-da8c-400a-8cac-e712e31f375d tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493" status: 200 len: 287 microversion: 2.1 time: 0.036710 Aug 31 11:02:39.579509 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 562/1094] 10.222.0.75 () {58 vars in 1251 bytes} [Wed Aug 31 11:02:39 2022] GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:40.592669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b3347a28-623d-4497-93b0-7baaa04289e0 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8dc14c0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:40.623650 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b3347a28-623d-4497-93b0-7baaa04289e0 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493" status: 200 len: 287 microversion: 2.1 time: 0.035499 Aug 31 11:02:40.624349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 533/1095] 10.222.0.75 () {58 vars in 1251 bytes} [Wed Aug 31 11:02:40 2022] GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:41.636649 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:41.637549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:41.642602 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2361ca15-ee30-4e59-bf3d-db056159b256 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8b540d0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:41.677556 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2361ca15-ee30-4e59-bf3d-db056159b256 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493" status: 200 len: 287 microversion: 2.1 time: 0.043425 Aug 31 11:02:41.678220 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 563/1096] 10.222.0.75 () {58 vars in 1251 bytes} [Wed Aug 31 11:02:41 2022] GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:42.690460 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=24 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:42.698832 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-51e486e7-325c-4fa8-a508-56e37c9555a5 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8c628b0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:42.739198 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-51e486e7-325c-4fa8-a508-56e37c9555a5 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493" status: 200 len: 288 microversion: 2.1 time: 0.051388 Aug 31 11:02:42.739833 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 534/1097] 10.222.0.75 () {58 vars in 1251 bytes} [Wed Aug 31 11:02:42 2022] GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493 => generated 288 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:42.752637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3c6eecd0-8ff9-4bea-8c81-80b2d398483d tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8c1dee0>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:42.817379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3c6eecd0-8ff9-4bea-8c81-80b2d398483d tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493" status: 202 len: 0 microversion: 2.1 time: 0.069555 Aug 31 11:02:42.818257 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 564/1098] 10.222.0.75 () {58 vars in 1254 bytes} [Wed Aug 31 11:02:42 2022] DELETE /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:02:42.826717 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-cf4d751c-56d4-4d1e-a832-de676345d177 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8b2f550>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:42.858298 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-cf4d751c-56d4-4d1e-a832-de676345d177 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493" status: 200 len: 287 microversion: 2.1 time: 0.035574 Aug 31 11:02:42.858936 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 535/1099] 10.222.0.75 () {58 vars in 1251 bytes} [Wed Aug 31 11:02:42 2022] GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:43.873412 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fe25640b-6fc0-4f5e-a5cf-ded4a7c87766 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8e1be50>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:43.900770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-fe25640b-6fc0-4f5e-a5cf-ded4a7c87766 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] HTTP exception thrown: Snapshot 253f390c-c2cc-4ab7-8083-0addf4799493 could not be found. Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fe25640b-6fc0-4f5e-a5cf-ded4a7c87766 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Request method failure captured: Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493 HTTP/1.1 Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz_NRN90GSnQCqc1QeFBnpu1_UFNV4HBYeLSLFuYYm8y8QPEa0Ij-2V7E4gI6ZR4wNumusEiD-GnVMWBr42X5soUeDGjWIK2Ih6AibLW2Sfv4v9qF4Vh98fla6oMrR9xqZSDzUr4xdImRF48NkghWPtw8EIMKteanlYEXQOkBGxd4VM Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 3fdf48ab6b994c72994b861fba4887fd Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:02:43.903131 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3fdf48ab6b994c72994b861fba4887fd"}]}] Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 3fdf48ab6b994c72994b861fba4887fd Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-VolumesSnapshotsTestJSON-1652952056-project Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 96c26d26a0af480ca9cbbd06502de729 Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1652952056-project Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Snapshot 253f390c-c2cc-4ab7-8083-0addf4799493 could not be found. Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '253f390c-c2cc-4ab7-8083-0addf4799493'} Aug 31 11:02:43.904590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 253f390c-c2cc-4ab7-8083-0addf4799493 could not be found. (HTTP 404) (Request-ID: req-fae160ce-6170-4c36-967a-36071fc18e0e) Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:43.905490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:02:43.906841 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 253f390c-c2cc-4ab7-8083-0addf4799493 could not be found. Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 11:02:43.908203 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 253f390c-c2cc-4ab7-8083-0addf4799493 could not be found. Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 253f390c-c2cc-4ab7-8083-0addf4799493 could not be found. Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-fe25640b-6fc0-4f5e-a5cf-ded4a7c87766 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Returning 404 to user: Snapshot 253f390c-c2cc-4ab7-8083-0addf4799493 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:43.909680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-fe25640b-6fc0-4f5e-a5cf-ded4a7c87766 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493" status: 404 len: 111 microversion: 2.1 time: 0.036439 Aug 31 11:02:43.910709 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 565/1100] 10.222.0.75 () {58 vars in 1251 bytes} [Wed Aug 31 11:02:43 2022] GET /compute/v2.1/os-snapshots/253f390c-c2cc-4ab7-8083-0addf4799493 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:02:43.910810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=4 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:43.911395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:02:43.916723 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c29ee968-fc87-476e-b2b5-fc7f31c24977 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a90bb940>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:43.982288 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c29ee968-fc87-476e-b2b5-fc7f31c24977 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae" status: 202 len: 0 microversion: 2.1 time: 0.072318 Aug 31 11:02:43.982859 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 536/1101] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 11:02:43 2022] DELETE /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:02:43.992014 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a6c697ca-9e43-4f2f-8d15-f80ca3ba5c55 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8d42790>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:44.043001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a6c697ca-9e43-4f2f-8d15-f80ca3ba5c55 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae" status: 200 len: 344 microversion: 2.1 time: 0.054644 Aug 31 11:02:44.043578 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 566/1102] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 11:02:43 2022] GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:02:45.059470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bcfebd16-bda7-4373-ba5e-ee6b49a0c590 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8cb9f70>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:45.092572 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-bcfebd16-bda7-4373-ba5e-ee6b49a0c590 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] HTTP exception thrown: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bcfebd16-bda7-4373-ba5e-ee6b49a0c590 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Request method failure captured: Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae HTTP/1.1 Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz_NRN90GSnQCqc1QeFBnpu1_UFNV4HBYeLSLFuYYm8y8QPEa0Ij-2V7E4gI6ZR4wNumusEiD-GnVMWBr42X5soUeDGjWIK2Ih6AibLW2Sfv4v9qF4Vh98fla6oMrR9xqZSDzUr4xdImRF48NkghWPtw8EIMKteanlYEXQOkBGxd4VM Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 3fdf48ab6b994c72994b861fba4887fd Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:02:45.104678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3fdf48ab6b994c72994b861fba4887fd"}]}] Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 3fdf48ab6b994c72994b861fba4887fd Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-VolumesSnapshotsTestJSON-1652952056-project Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 96c26d26a0af480ca9cbbd06502de729 Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1652952056-project Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '30b73db9-c818-40ba-8121-1843e8681fae'} Aug 31 11:02:45.106349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. (HTTP 404) (Request-ID: req-644da2bd-ea13-4e40-a7ef-bd9554c53b15) Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:45.107234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:02:45.108816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:02:45.110259 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bcfebd16-bda7-4373-ba5e-ee6b49a0c590 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Returning 404 to user: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bcfebd16-bda7-4373-ba5e-ee6b49a0c590 tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae" status: 404 len: 109 microversion: 2.1 time: 0.052311 Aug 31 11:02:45.111512 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 537/1103] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 11:02:45 2022] GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:02:45.118002 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9bddb4e2-bdb4-4574-a458-25714ad34d1b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8d96940>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:45.146445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-9bddb4e2-bdb4-4574-a458-25714ad34d1b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] HTTP exception thrown: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9bddb4e2-bdb4-4574-a458-25714ad34d1b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Request method failure captured: Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: DELETE /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae HTTP/1.1 Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz_NRN90GSnQCqc1QeFBnpu1_UFNV4HBYeLSLFuYYm8y8QPEa0Ij-2V7E4gI6ZR4wNumusEiD-GnVMWBr42X5soUeDGjWIK2Ih6AibLW2Sfv4v9qF4Vh98fla6oMrR9xqZSDzUr4xdImRF48NkghWPtw8EIMKteanlYEXQOkBGxd4VM Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 3fdf48ab6b994c72994b861fba4887fd Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:02:45.148367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3fdf48ab6b994c72994b861fba4887fd"}]}] Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 3fdf48ab6b994c72994b861fba4887fd Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-VolumesSnapshotsTestJSON-1652952056-project Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 96c26d26a0af480ca9cbbd06502de729 Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1652952056-project Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '30b73db9-c818-40ba-8121-1843e8681fae'} Aug 31 11:02:45.150001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. (HTTP 404) (Request-ID: req-36e3b261-fad9-41d0-9181-e8e5d364f8c1) Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:45.151008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:02:45.152469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 11:02:45.153860 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9bddb4e2-bdb4-4574-a458-25714ad34d1b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Returning 404 to user: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:45.155303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9bddb4e2-bdb4-4574-a458-25714ad34d1b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae" status: 404 len: 109 microversion: 2.1 time: 0.036211 Aug 31 11:02:45.156294 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 567/1104] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 11:02:45 2022] DELETE /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:02:45.158504 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9bd0b53d-4f5a-4903-9de5-d30c2271f82b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Calling method '.version_select at 0x7f37a8cb9af0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:45.188882 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-9bd0b53d-4f5a-4903-9de5-d30c2271f82b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] HTTP exception thrown: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9bd0b53d-4f5a-4903-9de5-d30c2271f82b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Request method failure captured: Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae HTTP/1.1 Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz_NRN90GSnQCqc1QeFBnpu1_UFNV4HBYeLSLFuYYm8y8QPEa0Ij-2V7E4gI6ZR4wNumusEiD-GnVMWBr42X5soUeDGjWIK2Ih6AibLW2Sfv4v9qF4Vh98fla6oMrR9xqZSDzUr4xdImRF48NkghWPtw8EIMKteanlYEXQOkBGxd4VM Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: 3fdf48ab6b994c72994b861fba4887fd Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:02:45.191203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/3fdf48ab6b994c72994b861fba4887fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/3fdf48ab6b994c72994b861fba4887fd"}]}] Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: 3fdf48ab6b994c72994b861fba4887fd Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1652952056 Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-VolumesSnapshotsTestJSON-1652952056-project Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 96c26d26a0af480ca9cbbd06502de729 Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1652952056-project Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '30b73db9-c818-40ba-8121-1843e8681fae'} Aug 31 11:02:45.192764 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. (HTTP 404) (Request-ID: req-2312637d-4e77-489b-9ced-1cbb6fd94d17) Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:45.193988 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:02:45.195275 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:02:45.196667 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9bd0b53d-4f5a-4903-9de5-d30c2271f82b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] Returning 404 to user: Volume 30b73db9-c818-40ba-8121-1843e8681fae could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9bd0b53d-4f5a-4903-9de5-d30c2271f82b tempest-VolumesSnapshotsTestJSON-1652952056 tempest-VolumesSnapshotsTestJSON-1652952056-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae" status: 404 len: 109 microversion: 2.1 time: 0.038794 Aug 31 11:02:45.198419 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 538/1105] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 11:02:45 2022] GET /compute/v2.1/os-volumes/30b73db9-c818-40ba-8121-1843e8681fae => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:02:46.821469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3c3af99e-5e6b-40ff-b610-bf87218bcefb tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Action: 'create', calling method: .version_select at 0x7f37a8b54e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-375926046", "metadata": {"Type": "work"}}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3c3af99e-5e6b-40ff-b610-bf87218bcefb tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Request method failure captured: Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 121 Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz_WS-VZtYLyMEU3o-t9Qb0Q9UrBKtdhL20ho2hWwgvUJ8I6u2H_hDc5m-ctu8oK4YFQU9wqN5KkhixcUmDbv9gC3-VFBloO-OzHqT32ZExxc219LJ_ru7bDvBavi8yALQaY10JXcNIPNjVLI7N0pJVy7cZoX7egwAIz210u2DCCg2c Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:02:46.837334 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aac87e28981846a6adb948e5689971ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aac87e28981846a6adb948e5689971ba"}]}] Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: fed9a0f026a54b1eb65b4246c74ff645 Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-375926046", "metadata": {"Type": "work"}}} Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: Aug 31 11:02:46.839141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-375926046', 'metadata': {'Type': 'work'}}}} Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise error Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:46.840222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 11:02:46.841910 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 11:02:46.843301 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 11:02:46.843301 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.843301 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3c3af99e-5e6b-40ff-b610-bf87218bcefb tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:46.843301 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3c3af99e-5e6b-40ff-b610-bf87218bcefb tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.150985 Aug 31 11:02:46.845219 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 568/1106] 10.222.0.75 () {60 vars in 1156 bytes} [Wed Aug 31 11:02:46 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:02:46.852260 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a69212c4-685e-4fc4-bde0-a88cdf1efa02 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Action: 'create', calling method: .version_select at 0x7f37a8dc15e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-728282227", "metadata": {"Type": "work"}}} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a69212c4-685e-4fc4-bde0-a88cdf1efa02 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Request method failure captured: Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 119 Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz_WS-VZtYLyMEU3o-t9Qb0Q9UrBKtdhL20ho2hWwgvUJ8I6u2H_hDc5m-ctu8oK4YFQU9wqN5KkhixcUmDbv9gC3-VFBloO-OzHqT32ZExxc219LJ_ru7bDvBavi8yALQaY10JXcNIPNjVLI7N0pJVy7cZoX7egwAIz210u2DCCg2c Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:02:46.858215 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aac87e28981846a6adb948e5689971ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aac87e28981846a6adb948e5689971ba"}]}] Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: fed9a0f026a54b1eb65b4246c74ff645 Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-728282227", "metadata": {"Type": "work"}}} Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: Aug 31 11:02:46.859927 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-728282227', 'metadata': {'Type': 'work'}}}} Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise error Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi '0' Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:46.860932 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 11:02:46.862588 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 11:02:46.864167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 11:02:46.864167 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.865245 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a69212c4-685e-4fc4-bde0-a88cdf1efa02 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:46.866200 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a69212c4-685e-4fc4-bde0-a88cdf1efa02 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.019779 Aug 31 11:02:46.866819 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 539/1107] 10.222.0.75 () {60 vars in 1156 bytes} [Wed Aug 31 11:02:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:02:46.876221 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b82304a0-4654-47d9-a9ac-3930acb98305 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Action: 'create', calling method: .version_select at 0x7f37a8a1ab80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1547758944", "metadata": {"Type": "work"}}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b82304a0-4654-47d9-a9ac-3930acb98305 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Request method failure captured: Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 119 Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz_WS-VZtYLyMEU3o-t9Qb0Q9UrBKtdhL20ho2hWwgvUJ8I6u2H_hDc5m-ctu8oK4YFQU9wqN5KkhixcUmDbv9gC3-VFBloO-OzHqT32ZExxc219LJ_ru7bDvBavi8yALQaY10JXcNIPNjVLI7N0pJVy7cZoX7egwAIz210u2DCCg2c Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:02:46.880154 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aac87e28981846a6adb948e5689971ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aac87e28981846a6adb948e5689971ba"}]}] Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: fed9a0f026a54b1eb65b4246c74ff645 Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1547758944", "metadata": {"Type": "work"}}} Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: Aug 31 11:02:46.881726 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1547758944', 'metadata': {'Type': 'work'}}}} Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise error Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi '' Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:46.882735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 11:02:46.884554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 11:02:46.886174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 11:02:46.886174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.886174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-b82304a0-4654-47d9-a9ac-3930acb98305 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:46.886174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-b82304a0-4654-47d9-a9ac-3930acb98305 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010086 Aug 31 11:02:46.886174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 569/1108] 10.222.0.75 () {60 vars in 1156 bytes} [Wed Aug 31 11:02:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 11:02:46.892362 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9ebc4b72-fb05-4016-a776-13f729035492 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Calling method '.version_select at 0x7f37a8bb4790>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:46.927034 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-9ebc4b72-fb05-4016-a776-13f729035492 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] HTTP exception thrown: Volume tempest-invalid-1672886439 could not be found. Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9ebc4b72-fb05-4016-a776-13f729035492 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Request method failure captured: Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1672886439 HTTP/1.1 Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz_WS-VZtYLyMEU3o-t9Qb0Q9UrBKtdhL20ho2hWwgvUJ8I6u2H_hDc5m-ctu8oK4YFQU9wqN5KkhixcUmDbv9gC3-VFBloO-OzHqT32ZExxc219LJ_ru7bDvBavi8yALQaY10JXcNIPNjVLI7N0pJVy7cZoX7egwAIz210u2DCCg2c Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:02:46.929027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aac87e28981846a6adb948e5689971ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aac87e28981846a6adb948e5689971ba"}]}] Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: fed9a0f026a54b1eb65b4246c74ff645 Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Volume tempest-invalid-1672886439 could not be found. Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'tempest-invalid-1672886439'} Aug 31 11:02:46.930589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1672886439 could not be found. (HTTP 404) (Request-ID: req-981c8daf-4f8b-4360-a2e3-838c74fa8cdd) Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.931470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:02:46.932765 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1672886439 could not be found. Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:46.934583 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1672886439 could not be found. Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1672886439 could not be found. Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9ebc4b72-fb05-4016-a776-13f729035492 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Returning 404 to user: Volume tempest-invalid-1672886439 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9ebc4b72-fb05-4016-a776-13f729035492 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1672886439" status: 404 len: 99 microversion: 2.1 time: 0.042518 Aug 31 11:02:46.936600 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 540/1109] 10.222.0.75 () {58 vars in 1218 bytes} [Wed Aug 31 11:02:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1672886439 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 11:02:46.943205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-096a0346-0ad7-4188-9328-1313cd12f6a9 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005845 Aug 31 11:02:46.944218 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 570/1110] 10.222.0.75 () {58 vars in 1140 bytes} [Wed Aug 31 11:02:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 11:02:46.954596 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-43d0f2a3-8971-41d1-9db6-e6268e6e3152 tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005262 Aug 31 11:02:46.955266 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 541/1111] 10.222.0.75 () {58 vars in 1137 bytes} [Wed Aug 31 11:02:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 11:02:46.964662 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-eae2b52e-4904-4879-ae92-25ce35f7abda tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Calling method '.version_select at 0x7f37a8a1a790>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:46.993025 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-eae2b52e-4904-4879-ae92-25ce35f7abda tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] HTTP exception thrown: Volume e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c could not be found. Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-eae2b52e-4904-4879-ae92-25ce35f7abda tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Request method failure captured: Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: DELETE /compute/v2.1/os-volumes/e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c HTTP/1.1 Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz_WS-VZtYLyMEU3o-t9Qb0Q9UrBKtdhL20ho2hWwgvUJ8I6u2H_hDc5m-ctu8oK4YFQU9wqN5KkhixcUmDbv9gC3-VFBloO-OzHqT32ZExxc219LJ_ru7bDvBavi8yALQaY10JXcNIPNjVLI7N0pJVy7cZoX7egwAIz210u2DCCg2c Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:02:46.995001 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aac87e28981846a6adb948e5689971ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aac87e28981846a6adb948e5689971ba"}]}] Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: fed9a0f026a54b1eb65b4246c74ff645 Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Volume e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c could not be found. Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c'} Aug 31 11:02:46.996516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c could not be found. (HTTP 404) (Request-ID: req-3e8d3ecc-330a-4379-b39f-a848f72005d5) Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.997436 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 11:02:46.998663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c could not be found. Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 11:02:46.999872 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c could not be found. Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c could not be found. Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-eae2b52e-4904-4879-ae92-25ce35f7abda tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Returning 404 to user: Volume e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-eae2b52e-4904-4879-ae92-25ce35f7abda tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c" status: 404 len: 109 microversion: 2.1 time: 0.035768 Aug 31 11:02:47.001054 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 571/1112] 10.222.0.75 () {58 vars in 1248 bytes} [Wed Aug 31 11:02:46 2022] DELETE /compute/v2.1/os-volumes/e4ba9b6e-50ac-448e-9705-1d3f4df9ff1c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:02:47.006337 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e37ee901-de55-4bb4-9ead-7926381b6fcf tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Calling method '.version_select at 0x7f37a8c623a0>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:47.034280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-e37ee901-de55-4bb4-9ead-7926381b6fcf tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] HTTP exception thrown: Volume ccab9bcf-8e1a-48b6-a960-e0b0eb167d14 could not be found. Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e37ee901-de55-4bb4-9ead-7926381b6fcf tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Request method failure captured: Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/os-volumes/ccab9bcf-8e1a-48b6-a960-e0b0eb167d14 HTTP/1.1 Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz_WS-VZtYLyMEU3o-t9Qb0Q9UrBKtdhL20ho2hWwgvUJ8I6u2H_hDc5m-ctu8oK4YFQU9wqN5KkhixcUmDbv9gC3-VFBloO-OzHqT32ZExxc219LJ_ru7bDvBavi8yALQaY10JXcNIPNjVLI7N0pJVy7cZoX7egwAIz210u2DCCg2c Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:02:47.036204 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_aac87e28981846a6adb948e5689971ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/aac87e28981846a6adb948e5689971ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/aac87e28981846a6adb948e5689971ba"}]}] Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: aac87e28981846a6adb948e5689971ba Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-VolumesNegativeTest-713368447 Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: fed9a0f026a54b1eb65b4246c74ff645 Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-VolumesNegativeTest-713368447-project Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Volume ccab9bcf-8e1a-48b6-a960-e0b0eb167d14 could not be found. Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': 'ccab9bcf-8e1a-48b6-a960-e0b0eb167d14'} Aug 31 11:02:47.038238 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ccab9bcf-8e1a-48b6-a960-e0b0eb167d14 could not be found. (HTTP 404) (Request-ID: req-d26ed74f-ded2-4d2a-8599-14698ba0deb8) Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:47.039386 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 11:02:47.040772 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ccab9bcf-8e1a-48b6-a960-e0b0eb167d14 could not be found. Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 11:02:47.042487 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ccab9bcf-8e1a-48b6-a960-e0b0eb167d14 could not be found. Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ccab9bcf-8e1a-48b6-a960-e0b0eb167d14 could not be found. Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e37ee901-de55-4bb4-9ead-7926381b6fcf tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] Returning 404 to user: Volume ccab9bcf-8e1a-48b6-a960-e0b0eb167d14 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e37ee901-de55-4bb4-9ead-7926381b6fcf tempest-VolumesNegativeTest-713368447 tempest-VolumesNegativeTest-713368447-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/ccab9bcf-8e1a-48b6-a960-e0b0eb167d14" status: 404 len: 109 microversion: 2.1 time: 0.035285 Aug 31 11:02:47.044497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 542/1113] 10.222.0.75 () {58 vars in 1245 bytes} [Wed Aug 31 11:02:47 2022] GET /compute/v2.1/os-volumes/ccab9bcf-8e1a-48b6-a960-e0b0eb167d14 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:02:54.434346 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-996087511", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1207752644", "security_groups": [{"name": "tempest-secgroup-smoke-1276854290"}], "block_device_mapping_v2": [{"uuid": "88df34f6-8e74-4940-8683-3ff24b4fc2af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "deccb10a-575f-42db-9e73-798b493ef699"}]}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:02:54.570286 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] validate_networks() for [('deccb10a-575f-42db-9e73-798b493ef699', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:02:54.964392 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:02:54.964821 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:02:54.965295 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:02:54.965706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:02:54.966138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:02:54.975239 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:54.975663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:54.976105 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:54.976834 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:54.977289 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:54.977713 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:54.995168 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Getting quotas for project fdd5d77d519c46689286cec82a24d9b7. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:02:54.999286 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Getting quotas for user 951b4d24f5c4460db22218f94ded0c57 and project fdd5d77d519c46689286cec82a24d9b7. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:02:55.073518 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:02:55.075782 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88df34f6-8e74-4940-8683-3ff24b4fc2af',volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:02:55.218087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0ebac14e-853d-46fc-8ba0-0a86e62e35ad tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788636 Aug 31 11:02:55.218731 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 572/1114] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 11:02:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:02:55.231357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b51825b6-9cf9-46b5-aa60-02489d5e84db tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:55.231971 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-b51825b6-9cf9-46b5-aa60-02489d5e84db tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:55.287083 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-b51825b6-9cf9-46b5-aa60-02489d5e84db tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:55.294220 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b51825b6-9cf9-46b5-aa60-02489d5e84db tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1094 microversion: 2.1 time: 0.068092 Aug 31 11:02:55.294787 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 543/1115] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:02:55 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:02:56.319476 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:56.320139 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:56.326977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:56.327475 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:56.327909 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:56.328605 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:56.329067 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:56.329492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:56.393316 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:56.401730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-3a4c1abd-d5c2-48aa-b8ba-6a5408d54fb1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1144 microversion: 2.1 time: 0.087121 Aug 31 11:02:56.402345 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 573/1116] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:02:56 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:02:57.426547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:57.427203 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:57.435395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:57.435968 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:57.436469 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:57.437272 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:57.437812 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:57.438644 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:57.504653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:57.512665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8530655c-37f8-4ad8-9f80-3b1c25b9297b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1144 microversion: 2.1 time: 0.092761 Aug 31 11:02:57.513263 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 544/1117] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:02:57 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:02:58.534471 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:58.535996 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:58.545611 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:58.546144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:58.546598 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:58.547276 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:58.547738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:58.548159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:58.627642 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:58.636194 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-31115d2b-0533-44f1-980a-08e962df45c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1200 microversion: 2.1 time: 0.105959 Aug 31 11:02:58.649374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 574/1118] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:02:58 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1200 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:02:59.657560 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:02:59.658190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:02:59.665644 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:59.666185 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:59.666611 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:59.667456 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:02:59.667907 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:02:59.668354 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:02:59.920737 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:02:59.929405 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9e745542-e428-4242-af9e-8ab10865e648 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.275938 Aug 31 11:02:59.930279 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 545/1119] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:02:59 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:00.061513 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-c5d02a0e-14bf-4c24-bd1c-34e579ebd0fe req-4e722043-4ec2-437b-b6f1-adca312362d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762fcaf1-82a4-4193-a52e-7291b50424d6", "tag": "f92c48f5-b387-444b-80ea-f9c5200764da"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:03:00.072777 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-c5d02a0e-14bf-4c24-bd1c-34e579ebd0fe req-4e722043-4ec2-437b-b6f1-adca312362d0 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:00.073278 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-c5d02a0e-14bf-4c24-bd1c-34e579ebd0fe req-4e722043-4ec2-437b-b6f1-adca312362d0 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:00.073705 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-c5d02a0e-14bf-4c24-bd1c-34e579ebd0fe req-4e722043-4ec2-437b-b6f1-adca312362d0 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:00.085616 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-c5d02a0e-14bf-4c24-bd1c-34e579ebd0fe req-4e722043-4ec2-437b-b6f1-adca312362d0 service nova] Creating event network-changed:f92c48f5-b387-444b-80ea-f9c5200764da for instance 762fcaf1-82a4-4193-a52e-7291b50424d6 on hv-cinder-79578 Aug 31 11:03:00.091183 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-c5d02a0e-14bf-4c24-bd1c-34e579ebd0fe req-4e722043-4ec2-437b-b6f1-adca312362d0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 Aug 31 11:03:00.091770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 575/1120] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:03:00.951816 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:00.952369 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:00.959663 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:00.960121 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:00.960537 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:00.961244 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:00.961717 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:00.962177 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:01.205866 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:01.214105 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-7fba6387-4e42-4ea9-8f44-a1f968c7cae2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.266290 Aug 31 11:03:01.214644 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 546/1121] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:00 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:02.236628 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:02.237506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:02.244303 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:02.244795 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:02.245230 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:02.246017 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:02.246474 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:02.246902 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:02.387052 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:02.395003 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-72694036-9369-4e8f-8b02-f0c95209ac46 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.163745 Aug 31 11:03:02.395577 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 576/1122] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:02 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:03.419679 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:03.420281 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:03.426749 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:03.427223 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:03.427857 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:03.428543 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:03.429021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:03.429437 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:03.569271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:03.573898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-fcc55fb4-f3fd-4361-9d33-6f57de15ccf5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.159814 Aug 31 11:03:03.574529 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 547/1123] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:03 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:04.595017 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:04.595759 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:04.602228 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:04.602706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:04.603129 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:04.603817 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:04.604258 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:04.604678 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:04.737968 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:04.746161 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-a217da98-c4a4-4f77-9f75-7afe65a623a3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.155006 Aug 31 11:03:04.746753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 577/1124] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:04 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:05.767331 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:05.768002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:05.770552 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:05.776223 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:05.776708 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:05.777135 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:05.777860 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:05.778309 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:05.778722 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:05.937624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:05.947004 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-f02e8614-2561-468e-8cd8-4a5e02dc7b3f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.183644 Aug 31 11:03:05.947624 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 548/1125] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:05 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:06.967240 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:06.967956 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:06.973150 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:06.973818 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=6 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:06.976590 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:06.977087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:06.977533 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:06.978314 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:06.978760 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:06.979184 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:07.119558 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:07.127470 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0b366020-8535-4d7c-9c40-3bc2620fae3a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.164279 Aug 31 11:03:07.128042 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 578/1126] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:06 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:08.148434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:08.149089 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:08.155739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:08.156270 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:08.156687 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:08.157394 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:08.157880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:08.158301 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:08.294489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:08.302511 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-93bbe2eb-75aa-447c-9536-facce19ad49e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.158093 Aug 31 11:03:08.303334 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 549/1127] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:08 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:09.327831 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:09.328802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:09.338917 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:09.339399 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:09.339830 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:09.340516 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:09.340964 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:09.341379 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:09.491592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:09.500816 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-65954dd8-91ae-4d3a-bc0c-c6a31626cf38 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.179235 Aug 31 11:03:09.501732 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 579/1128] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:09 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:10.522377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:10.522883 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:10.529671 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:10.530184 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:10.530599 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:10.531290 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:10.531739 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:10.532157 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:10.668039 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:10.679616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-8dba56ec-dacc-4bf7-bb3d-2cf38bd19141 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.161505 Aug 31 11:03:10.680560 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 550/1129] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:10 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:11.162770 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-eba1dc20-1402-46f8-82d1-528b40c354f1 req-e61a53e8-0188-4f8d-926b-2b3baf5fa82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762fcaf1-82a4-4193-a52e-7291b50424d6", "name": "network-vif-plugged", "status": "completed", "tag": "f92c48f5-b387-444b-80ea-f9c5200764da"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:03:11.173254 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-eba1dc20-1402-46f8-82d1-528b40c354f1 req-e61a53e8-0188-4f8d-926b-2b3baf5fa82b service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:11.173853 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-eba1dc20-1402-46f8-82d1-528b40c354f1 req-e61a53e8-0188-4f8d-926b-2b3baf5fa82b service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:11.174294 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-eba1dc20-1402-46f8-82d1-528b40c354f1 req-e61a53e8-0188-4f8d-926b-2b3baf5fa82b service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:11.186038 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-eba1dc20-1402-46f8-82d1-528b40c354f1 req-e61a53e8-0188-4f8d-926b-2b3baf5fa82b service nova] Creating event network-vif-plugged:f92c48f5-b387-444b-80ea-f9c5200764da for instance 762fcaf1-82a4-4193-a52e-7291b50424d6 on hv-cinder-79578 Aug 31 11:03:11.191378 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-eba1dc20-1402-46f8-82d1-528b40c354f1 req-e61a53e8-0188-4f8d-926b-2b3baf5fa82b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032574 Aug 31 11:03:11.191977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 580/1130] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:03:11.704711 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:11.705628 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:11.716644 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:11.717452 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:11.718438 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:11.719401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:11.720160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:11.720870 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:12.146257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:12.154672 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ebb3ca56-ab1f-4261-8965-253cb87e7869 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1266 microversion: 2.1 time: 0.456553 Aug 31 11:03:12.155395 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 551/1131] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:11 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1266 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:13.176562 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:13.177264 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:13.183660 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:13.184147 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:13.184583 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:13.185283 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:13.185733 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:13.186184 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:13.332385 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:13.341074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-2da35b65-a745-48a5-b115-1f00a85a089b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1452 microversion: 2.1 time: 0.169233 Aug 31 11:03:13.341675 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 581/1132] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:13 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:13.363558 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:13.364175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:13.370863 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:13.371569 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:13.372076 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:13.372862 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:13.373549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:13.374107 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:13.517979 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:13.526113 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a2b6be76-7489-4879-bcbd-19050a6ccab2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1452 microversion: 2.1 time: 0.167421 Aug 31 11:03:13.526769 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 552/1133] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:13 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:14.270056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:14.270551 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:14.273722 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-eb5dadbf-449e-4e4b-abdc-2e422a81d6e0 req-e5826bc6-4340-4995-a8a6-d0686004e988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c91b10cf-8d7d-4896-be69-bc4c8089a324", "tag": "5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:03:14.277592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:14.278484 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:14.278933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:14.279643 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:14.280275 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:14.280863 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:14.284901 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-eb5dadbf-449e-4e4b-abdc-2e422a81d6e0 req-e5826bc6-4340-4995-a8a6-d0686004e988 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:14.285377 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-eb5dadbf-449e-4e4b-abdc-2e422a81d6e0 req-e5826bc6-4340-4995-a8a6-d0686004e988 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:14.285828 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-eb5dadbf-449e-4e4b-abdc-2e422a81d6e0 req-e5826bc6-4340-4995-a8a6-d0686004e988 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:14.298800 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-eb5dadbf-449e-4e4b-abdc-2e422a81d6e0 req-e5826bc6-4340-4995-a8a6-d0686004e988 service nova] Creating event network-changed:5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6 for instance c91b10cf-8d7d-4896-be69-bc4c8089a324 on hv-cinder-79578 Aug 31 11:03:14.305438 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-eb5dadbf-449e-4e4b-abdc-2e422a81d6e0 req-e5826bc6-4340-4995-a8a6-d0686004e988 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036272 Aug 31 11:03:14.306662 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 553/1134] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:03:14.313138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:03:14.401737 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-365dcd91-52e1-4a9a-97ef-ff017f189f73 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 204 len: 0 microversion: 2.1 time: 0.135196 Aug 31 11:03:14.404678 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 582/1135] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:03:14 2022] DELETE /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:03:14.414921 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:14.416359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:14.424489 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:14.424960 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:14.425479 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:14.426481 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:14.426931 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:14.427349 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:14.667791 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:14.680910 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-c311c598-8f54-4b47-80d0-67c5432a7c28 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.270116 Aug 31 11:03:14.694575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 554/1136] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:14 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:15.572374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-cad74356-dcf4-4d57-b69d-21a6f455d10a req-dc3419af-c0b9-4233-a97e-adef25ca8fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762fcaf1-82a4-4193-a52e-7291b50424d6", "tag": "f92c48f5-b387-444b-80ea-f9c5200764da"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:03:15.582962 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-cad74356-dcf4-4d57-b69d-21a6f455d10a req-dc3419af-c0b9-4233-a97e-adef25ca8fbd service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:15.583473 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-cad74356-dcf4-4d57-b69d-21a6f455d10a req-dc3419af-c0b9-4233-a97e-adef25ca8fbd service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:15.583906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-cad74356-dcf4-4d57-b69d-21a6f455d10a req-dc3419af-c0b9-4233-a97e-adef25ca8fbd service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:15.597212 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-cad74356-dcf4-4d57-b69d-21a6f455d10a req-dc3419af-c0b9-4233-a97e-adef25ca8fbd service nova] Creating event network-changed:f92c48f5-b387-444b-80ea-f9c5200764da for instance 762fcaf1-82a4-4193-a52e-7291b50424d6 on hv-cinder-79578 Aug 31 11:03:15.602647 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-cad74356-dcf4-4d57-b69d-21a6f455d10a req-dc3419af-c0b9-4233-a97e-adef25ca8fbd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034436 Aug 31 11:03:15.603576 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 583/1137] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:03:15.704248 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:15.704914 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:15.711946 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:15.712431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:15.712864 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:15.713689 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:15.714175 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:15.714581 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:15.994036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:16.010020 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e8015e78-f08c-46f5-b8ac-ace4c1bfcf00 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.309831 Aug 31 11:03:16.010656 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 555/1138] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:15 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:17.034870 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:17.036426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:17.045093 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:17.045663 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:17.046402 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:17.047175 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:17.047706 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:17.048176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:17.362741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd64a3d12f7ae4c8982bdc54b5853b169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54f6126a98384bd189b960708bb4376e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:03:17.372213 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-e2931c17-39bb-4d58-a4bf-6a0d64175696 tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 200 len: 1569 microversion: 2.1 time: 0.343348 Aug 31 11:03:17.373172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 584/1139] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:17 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 1569 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:03:17.642074 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-1383e0de-bd30-4b2d-a62e-bd5157f5f0ae req-4812a76c-9fa7-4f7d-a2b7-6d23e75cba35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c91b10cf-8d7d-4896-be69-bc4c8089a324", "name": "network-vif-deleted", "tag": "5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:03:17.652272 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-1383e0de-bd30-4b2d-a62e-bd5157f5f0ae req-4812a76c-9fa7-4f7d-a2b7-6d23e75cba35 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:17.652796 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-1383e0de-bd30-4b2d-a62e-bd5157f5f0ae req-4812a76c-9fa7-4f7d-a2b7-6d23e75cba35 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:17.653222 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-1383e0de-bd30-4b2d-a62e-bd5157f5f0ae req-4812a76c-9fa7-4f7d-a2b7-6d23e75cba35 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:17.664500 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-1383e0de-bd30-4b2d-a62e-bd5157f5f0ae req-4812a76c-9fa7-4f7d-a2b7-6d23e75cba35 service nova] Creating event network-vif-deleted:5b7394c6-e338-409d-b4c7-c7a0ac4dcdf6 for instance c91b10cf-8d7d-4896-be69-bc4c8089a324 on hv-cinder-79578 Aug 31 11:03:17.669653 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-1383e0de-bd30-4b2d-a62e-bd5157f5f0ae req-4812a76c-9fa7-4f7d-a2b7-6d23e75cba35 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031533 Aug 31 11:03:17.670250 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 556/1140] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:03:18.394143 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:18.394754 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] [instance: c91b10cf-8d7d-4896-be69-bc4c8089a324] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:03:18.401446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:18.401966 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:18.402404 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:18.403117 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:03:18.403566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:03:18.403991 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:03:18.417524 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] HTTP exception thrown: Instance c91b10cf-8d7d-4896-be69-bc4c8089a324 could not be found. Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Request method failure captured: Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 HTTP/1.1 Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz6VVrTSbD2GCTIWspaY8pE5Pi-NrcLH7kqi10IUXkZKJpIO-D89Td15i6gkTyWekJKPf3gOtFhc-Hfmnu4U8RNDHHbwjNBc9plwTwe7WUD_mxMKfyoyF7QkqhhA7WpVqFqTAvwcj1mW0PnW5KZpFwVRgeyYtSyhXJmpR0nyTeXUvlw Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: 54f6126a98384bd189b960708bb4376e Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-TestShelveInstance-242523454 Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:03:18.419367 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_54f6126a98384bd189b960708bb4376e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/54f6126a98384bd189b960708bb4376e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/54f6126a98384bd189b960708bb4376e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/54f6126a98384bd189b960708bb4376e"}]}] Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-TestShelveInstance-242523454 Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: 54f6126a98384bd189b960708bb4376e Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-TestShelveInstance-242523454 Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-TestShelveInstance-242523454-project Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: d64a3d12f7ae4c8982bdc54b5853b169 Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-TestShelveInstance-242523454-project Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance c91b10cf-8d7d-4896-be69-bc4c8089a324 could not be found. Aug 31 11:03:18.421081 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'c91b10cf-8d7d-4896-be69-bc4c8089a324'} Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c91b10cf-8d7d-4896-be69-bc4c8089a324 could not be found. Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:03:18.422035 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c91b10cf-8d7d-4896-be69-bc4c8089a324 could not be found. Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c91b10cf-8d7d-4896-be69-bc4c8089a324 could not be found. Aug 31 11:03:18.423458 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:03:18.424716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Returning 404 to user: Instance c91b10cf-8d7d-4896-be69-bc4c8089a324 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:03:18.424716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-104577fb-02b4-4ed9-a289-579e7fc4f18c tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324" status: 404 len: 111 microversion: 2.1 time: 0.030968 Aug 31 11:03:18.424716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 585/1141] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:03:18 2022] GET /compute/v2.1/servers/c91b10cf-8d7d-4896-be69-bc4c8089a324 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:03:18.604205 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-b6da41ea-3504-4836-9e15-3de8d5ae2e2d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] Calling method '.version_select at 0x7f37a8d1d160>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:03:18.627615 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-b6da41ea-3504-4836-9e15-3de8d5ae2e2d tempest-TestShelveInstance-242523454 tempest-TestShelveInstance-242523454-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-499325673" status: 202 len: 0 microversion: 2.1 time: 0.030216 Aug 31 11:03:18.628382 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 557/1142] 10.222.0.75 () {58 vars in 1251 bytes} [Wed Aug 31 11:03:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-499325673 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 11:05:13.267978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR oslo.messaging._drivers.impl_rabbit [-] [217dc50a-ff92-4058-894a-cdafda3f1131] AMQP server on 10.222.0.75:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 11:05:13.269087 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:13.270182 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:13.272383 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 31 11:05:13.281463 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:13.282352 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:13.294574 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:13.295051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:13.295482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:13.296317 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:13.296682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:13.297079 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:13.323671 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Going to try to terminate instance {{(pid=120482) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:05:13.403527 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-1dda0dcf-d135-4f3c-bfbe-d6e7ecb259d1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "DELETE /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 204 len: 0 microversion: 2.1 time: 0.139066 Aug 31 11:05:13.404123 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 586/1143] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:05:13 2022] DELETE /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:05:13.412117 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=70 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:13.412913 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:13.414573 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:05:13.414721 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Wed Aug 31 11:05:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 (ip 10.222.0.75) !!! Aug 31 11:05:13.419843 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:13.420550 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:13.430499 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:13.431065 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:13.431492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:13.432184 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:13.432629 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:13.433044 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:13.785975 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:13.794160 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-11e154e4-9dbc-4f8d-91dd-f232f90950c6 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1576 microversion: 2.1 time: 0.384378 Aug 31 11:05:13.794671 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 558/1144] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:13 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1576 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:05:14.819263 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:14.819977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:14.832176 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:14.832672 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:14.833101 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:14.833819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:14.834287 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:14.834712 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:14.838510 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO oslo.messaging._drivers.impl_rabbit [-] [217dc50a-ff92-4058-894a-cdafda3f1131] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 47690. Aug 31 11:05:15.041382 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:15.052419 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-bea34513-28be-4312-b2e3-98d23a252449 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1576 microversion: 2.1 time: 0.239210 Aug 31 11:05:15.052987 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 587/1145] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:14 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:16.074350 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:16.074959 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:16.081809 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:16.082340 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:16.082766 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:16.083470 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:16.083884 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:16.084369 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:16.176617 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:16.184601 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e0e6a5ed-86c4-435f-beac-c87039e530f2 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 200 len: 1508 microversion: 2.1 time: 0.114351 Aug 31 11:05:16.185918 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 559/1146] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:16 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 1508 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:16.261536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-3a4d1e0a-20f7-4c34-9947-67a2868d27c9 req-bfd7c3cc-0820-4a61-8629-f0f80a2263db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762fcaf1-82a4-4193-a52e-7291b50424d6", "name": "network-vif-deleted", "tag": "f92c48f5-b387-444b-80ea-f9c5200764da"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:16.271680 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-3a4d1e0a-20f7-4c34-9947-67a2868d27c9 req-bfd7c3cc-0820-4a61-8629-f0f80a2263db service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:16.272163 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-3a4d1e0a-20f7-4c34-9947-67a2868d27c9 req-bfd7c3cc-0820-4a61-8629-f0f80a2263db service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:16.272600 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-3a4d1e0a-20f7-4c34-9947-67a2868d27c9 req-bfd7c3cc-0820-4a61-8629-f0f80a2263db service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:16.285108 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-3a4d1e0a-20f7-4c34-9947-67a2868d27c9 req-bfd7c3cc-0820-4a61-8629-f0f80a2263db service nova] Creating event network-vif-deleted:f92c48f5-b387-444b-80ea-f9c5200764da for instance 762fcaf1-82a4-4193-a52e-7291b50424d6 on hv-cinder-79578 Aug 31 11:05:16.290549 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-3a4d1e0a-20f7-4c34-9947-67a2868d27c9 req-bfd7c3cc-0820-4a61-8629-f0f80a2263db service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117631 Aug 31 11:05:16.291256 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 588/1147] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:17.209241 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:17.209855 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:17.216775 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:17.217265 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:17.217705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:17.218465 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:17.218946 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:17.219346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:17.232974 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] HTTP exception thrown: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Request method failure captured: Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 HTTP/1.1 Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz_Bw2ACGMmsEHJ359oc6bb5ef0dIcw1gzCuslprztUbVQX7CgLs8x8hDNjIyOR7fUIFRRth-tN132bF-2BfgKZf4Jpl84GAvDM6YVN5KJrsQLXQrZlytzQ-uJv3E1X0u5YEyTotVA2FRUfY9aK3dtHYHznvyy3hlYawUOP9mdraGQA Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:05:17.234647 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fdd5d77d519c46689286cec82a24d9b7"}]}] Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 951b4d24f5c4460db22218f94ded0c57 Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:05:17.237164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '762fcaf1-82a4-4193-a52e-7291b50424d6'} Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:05:17.238201 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:05:17.239659 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:05:17.240953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Returning 404 to user: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:05:17.240953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-4f953804-687d-4b54-8e4a-833b80ed51e5 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 404 len: 111 microversion: 2.1 time: 0.030885 Aug 31 11:05:17.240953 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 560/1148] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:17 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:05:17.336852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-379579741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1207752644", "security_groups": [{"name": "tempest-secgroup-smoke-1276854290"}], "block_device_mapping_v2": [{"uuid": "88df34f6-8e74-4940-8683-3ff24b4fc2af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "deccb10a-575f-42db-9e73-798b493ef699"}]}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:17.454816 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] validate_networks() for [('deccb10a-575f-42db-9e73-798b493ef699', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:05:17.919148 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:05:17.919582 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:05:17.920053 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:05:17.920464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:05:17.920878 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:05:17.930071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:17.930554 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:17.930992 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:17.931751 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:17.932205 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:17.932694 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:17.955080 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Getting quotas for project fdd5d77d519c46689286cec82a24d9b7. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:05:17.959146 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Getting quotas for user 951b4d24f5c4460db22218f94ded0c57 and project fdd5d77d519c46689286cec82a24d9b7. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:05:18.030490 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:05:18.032802 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88df34f6-8e74-4940-8683-3ff24b4fc2af',volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:05:18.180730 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-90e0879a-c2be-4c1f-b9d2-0e7a80ad9629 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.848724 Aug 31 11:05:18.181544 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 589/1149] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 11:05:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:05:18.192640 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-43e12e38-cf12-4bd2-ab2a-103aefda8b3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:18.193255 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-43e12e38-cf12-4bd2-ab2a-103aefda8b3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:18.246845 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-43e12e38-cf12-4bd2-ab2a-103aefda8b3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:18.257030 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-43e12e38-cf12-4bd2-ab2a-103aefda8b3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1094 microversion: 2.1 time: 0.068545 Aug 31 11:05:18.257575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 561/1150] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:18 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:19.276797 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:19.277443 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:19.284466 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:19.284949 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:19.285430 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:19.286144 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:19.286587 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:19.287013 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:19.360371 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:19.368373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-cec67396-b985-496e-8b2d-833f336368ac tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1192 microversion: 2.1 time: 0.095679 Aug 31 11:05:19.368942 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 590/1151] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:19 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:20.389036 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:20.389705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:20.396271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:20.396760 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:20.397411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:20.398233 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:20.398694 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:20.399118 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:20.585251 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:20.595901 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9a694e7c-c786-4e65-8e0f-92c4893a3fd3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.210976 Aug 31 11:05:20.596488 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 562/1152] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:20 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:21.131869 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-076400f0-e0c6-43d9-9fb3-48755b44997e req-2a586655-30f0-4f1a-85fb-7711bd2b39a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f459a161-9137-4822-8b74-5a3ae7204249", "tag": "cc8825cb-948e-413c-a8a1-fab68a1da0d6"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:21.142394 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-076400f0-e0c6-43d9-9fb3-48755b44997e req-2a586655-30f0-4f1a-85fb-7711bd2b39a7 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:21.143260 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-076400f0-e0c6-43d9-9fb3-48755b44997e req-2a586655-30f0-4f1a-85fb-7711bd2b39a7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:21.143749 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-076400f0-e0c6-43d9-9fb3-48755b44997e req-2a586655-30f0-4f1a-85fb-7711bd2b39a7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:21.155238 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-076400f0-e0c6-43d9-9fb3-48755b44997e req-2a586655-30f0-4f1a-85fb-7711bd2b39a7 service nova] Creating event network-changed:cc8825cb-948e-413c-a8a1-fab68a1da0d6 for instance f459a161-9137-4822-8b74-5a3ae7204249 on hv-cinder-79578 Aug 31 11:05:21.160119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-076400f0-e0c6-43d9-9fb3-48755b44997e req-2a586655-30f0-4f1a-85fb-7711bd2b39a7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 Aug 31 11:05:21.160790 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 591/1153] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:21.617186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:21.617820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:21.624894 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:21.625393 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:21.625987 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:21.626707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:21.627166 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:21.627593 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:21.931080 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:21.939594 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6959bded-0428-4fc0-8080-cd41a3039524 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.326594 Aug 31 11:05:21.940153 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 563/1154] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:21 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:22.966711 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:22.967846 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:22.977920 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:22.978423 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:22.978851 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:22.979531 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:22.979977 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:22.980391 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:23.132607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:23.142174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9db45da4-7c06-4d8f-9cce-70ca1fcb5b6d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.183700 Aug 31 11:05:23.142787 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 592/1155] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:22 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:24.167456 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:24.168565 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:24.179394 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:24.179874 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:24.180314 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:24.181222 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:24.181980 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:24.182411 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:24.326048 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:24.333894 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bc63e935-9f14-435e-9e2a-8ec3cfc0958e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.173105 Aug 31 11:05:24.334465 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 564/1156] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:24 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:25.360032 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:25.361167 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:25.370653 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:25.371142 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:25.371576 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:25.372268 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:25.372723 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:25.373146 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:25.521016 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:25.532506 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d5f2e52a-2410-4d88-92ec-e228f0bf6d6a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.179278 Aug 31 11:05:25.533323 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 593/1157] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:25 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:26.565848 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:26.566747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:26.575793 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:26.576269 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:26.576700 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:26.577384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:26.577835 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:26.578274 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:26.721381 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:26.730099 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-d1767013-113f-44a1-a5ea-6933366bbeeb tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.171324 Aug 31 11:05:26.730656 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 565/1158] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:26 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:27.750445 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:27.751028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:27.757940 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:27.758444 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:27.758852 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:27.759561 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:27.760049 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:27.760475 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:27.901363 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:27.909735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-71d6caf1-0f97-4e81-b647-9a36b2508675 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.163311 Aug 31 11:05:27.910307 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 594/1159] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:27 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:28.936780 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:28.938174 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:28.941857 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:28.949621 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:28.950134 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:28.950570 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:28.951268 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:28.951715 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:28.952129 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:29.091425 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:29.099498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-e9d4c8fd-a895-4bab-8e91-3b156f12ec4e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.169439 Aug 31 11:05:29.100057 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 566/1160] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:28 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:30.120693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:30.121270 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:30.123374 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:30.124051 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=6 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:30.130978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:30.131463 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:30.131898 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:30.132687 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:30.133174 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:30.133596 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:30.278216 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:30.287631 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-82df3e16-1efe-492e-a7ff-4c979cd7d7f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.171000 Aug 31 11:05:30.288208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 595/1161] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:30 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:31.313033 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:31.314096 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:31.325138 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:31.326161 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:31.326893 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:31.328049 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:31.328810 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:31.329536 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:31.466695 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:31.479616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-21af36c8-2d7a-4d7e-b6d8-51155045c1c4 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.173368 Aug 31 11:05:31.480444 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 567/1162] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:31 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:31.941280 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-421bf3a7-2074-4e15-a02e-5d1dab0a7658 req-f5e30e1f-086e-4bf1-9c12-6947db9b68c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f459a161-9137-4822-8b74-5a3ae7204249", "name": "network-vif-plugged", "status": "completed", "tag": "cc8825cb-948e-413c-a8a1-fab68a1da0d6"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:31.956040 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-421bf3a7-2074-4e15-a02e-5d1dab0a7658 req-f5e30e1f-086e-4bf1-9c12-6947db9b68c7 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:31.957042 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-421bf3a7-2074-4e15-a02e-5d1dab0a7658 req-f5e30e1f-086e-4bf1-9c12-6947db9b68c7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:31.957808 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-421bf3a7-2074-4e15-a02e-5d1dab0a7658 req-f5e30e1f-086e-4bf1-9c12-6947db9b68c7 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:31.969795 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-421bf3a7-2074-4e15-a02e-5d1dab0a7658 req-f5e30e1f-086e-4bf1-9c12-6947db9b68c7 service nova] Creating event network-vif-plugged:cc8825cb-948e-413c-a8a1-fab68a1da0d6 for instance f459a161-9137-4822-8b74-5a3ae7204249 on hv-cinder-79578 Aug 31 11:05:31.974932 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-421bf3a7-2074-4e15-a02e-5d1dab0a7658 req-f5e30e1f-086e-4bf1-9c12-6947db9b68c7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095095 Aug 31 11:05:31.975509 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 596/1163] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:05:32.509961 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:32.510569 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:32.517409 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:32.517915 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:32.518352 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:32.519132 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:32.519497 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:32.519901 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:32.671648 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:32.684384 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-72d3c9b8-e449-494b-aa09-3d5db5f9fb0f tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.181022 Aug 31 11:05:32.685286 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 568/1164] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:32 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:33.712674 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:33.713481 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:33.720164 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:33.720645 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:33.721072 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:33.721757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:33.722238 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:33.722651 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:33.871480 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:33.879933 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-da1636d7-2070-4346-9692-44b407c7b2f3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1266 microversion: 2.1 time: 0.173468 Aug 31 11:05:33.880523 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 597/1165] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:33 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:34.900982 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:34.901564 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:34.908949 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:34.909431 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:34.909897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:34.910590 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:34.911042 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:34.911461 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:35.053196 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:35.061378 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-291b57e5-81e1-4209-8492-1ae2456326c3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1451 microversion: 2.1 time: 0.164416 Aug 31 11:05:35.061977 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 569/1166] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:34 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:35.081736 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:05:35.082401 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:05:35.089426 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:35.089973 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:35.090420 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:35.091151 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:35.091608 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:35.092036 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:35.232644 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:05:35.245172 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0bca6b24-c338-42be-bbf4-7a0f1a5e6706 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1451 microversion: 2.1 time: 0.167387 Aug 31 11:05:35.245764 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 598/1167] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:05:35 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:05:36.885542 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [req-bf060445-ed9b-42d6-8a0a-b9f5ff652fa2 req-28030b81-d711-4c3a-bdc8-017f72b8861b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f459a161-9137-4822-8b74-5a3ae7204249", "tag": "cc8825cb-948e-413c-a8a1-fab68a1da0d6"}]} {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:05:36.896009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-bf060445-ed9b-42d6-8a0a-b9f5ff652fa2 req-28030b81-d711-4c3a-bdc8-017f72b8861b service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:05:36.896711 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-bf060445-ed9b-42d6-8a0a-b9f5ff652fa2 req-28030b81-d711-4c3a-bdc8-017f72b8861b service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:05:36.897134 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [req-bf060445-ed9b-42d6-8a0a-b9f5ff652fa2 req-28030b81-d711-4c3a-bdc8-017f72b8861b service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:05:36.908969 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.compute.server_external_events [req-bf060445-ed9b-42d6-8a0a-b9f5ff652fa2 req-28030b81-d711-4c3a-bdc8-017f72b8861b service nova] Creating event network-changed:cc8825cb-948e-413c-a8a1-fab68a1da0d6 for instance f459a161-9137-4822-8b74-5a3ae7204249 on hv-cinder-79578 Aug 31 11:05:36.912453 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR oslo.messaging._drivers.impl_rabbit [req-bf060445-ed9b-42d6-8a0a-b9f5ff652fa2 req-28030b81-d711-4c3a-bdc8-017f72b8861b service nova] [97fd48fc-2876-4c30-a65f-f014cf581fc5] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 11:05:37.921336 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO oslo.messaging._drivers.impl_rabbit [req-bf060445-ed9b-42d6-8a0a-b9f5ff652fa2 req-28030b81-d711-4c3a-bdc8-017f72b8861b service nova] [97fd48fc-2876-4c30-a65f-f014cf581fc5] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 47778. Aug 31 11:05:37.924983 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [req-bf060445-ed9b-42d6-8a0a-b9f5ff652fa2 req-28030b81-d711-4c3a-bdc8-017f72b8861b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.043552 Aug 31 11:05:37.925729 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 570/1168] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:16.295240 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:16.296019 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:16.298435 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 11:07:16.298622 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Wed Aug 31 11:07:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.75) !!! Aug 31 11:07:16.303354 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1575160406", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1207752644", "security_groups": [{"name": "tempest-secgroup-smoke-1276854290"}], "block_device_mapping_v2": [{"uuid": "4cc6f0fc-8d28-4e4c-bb40-a6890c3ec9c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "deccb10a-575f-42db-9e73-798b493ef699"}]}} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:16.424020 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.network.neutron [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] validate_networks() for [('deccb10a-575f-42db-9e73-798b493ef699', None, None, None, None, None)] {{(pid=120482) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 11:07:16.806617 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Flavor limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 11:07:16.807639 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Image limits 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 11:07:16.808316 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Flavor pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 11:07:16.808986 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Image pref 0:0:0 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 11:07:16.809645 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.virt.hardware [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 11:07:16.823803 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:16.824486 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:16.825137 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:16.826097 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:16.826580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:16.827008 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:16.845487 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Getting quotas for project fdd5d77d519c46689286cec82a24d9b7. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 11:07:16.849934 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.quota [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Getting quotas for user 951b4d24f5c4460db22218f94ded0c57 and project fdd5d77d519c46689286cec82a24d9b7. Resources: {'cores', 'ram', 'instances'} {{(pid=120482) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 11:07:16.908532 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Going to run 1 instances... {{(pid=120482) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 11:07:16.910734 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4cc6f0fc-8d28-4e4c-bb40-a6890c3ec9c8',volume_size=None,volume_type=None)] {{(pid=120482) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 11:07:17.075005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-f4fa44c8-28a6-4944-b4f4-2e0855ad6095 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.782647 Aug 31 11:07:17.075653 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 599/1169] 10.222.0.75 () {60 vars in 1147 bytes} [Wed Aug 31 11:07:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 11:07:17.085498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=28 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:17.086357 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=64 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:17.087268 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:07:17.087434 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Wed Aug 31 11:07:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 (ip 10.222.0.75) !!! Aug 31 11:07:17.101938 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-ecbc840d-e210-4059-9ee5-a4747d513696 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:17.102640 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-ecbc840d-e210-4059-9ee5-a4747d513696 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:17.157562 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-ecbc840d-e210-4059-9ee5-a4747d513696 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:17.164916 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-ecbc840d-e210-4059-9ee5-a4747d513696 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1095 microversion: 2.1 time: 0.081945 Aug 31 11:07:17.165876 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 571/1170] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:17 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:18.186735 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:18.187397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:18.194103 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.194584 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.195003 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:18.195722 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:18.196161 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:18.196582 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:18.259702 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:18.267716 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-5e790820-c577-4c39-bddd-75c36cbd224d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1193 microversion: 2.1 time: 0.086053 Aug 31 11:07:18.268342 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 600/1171] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:18 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:19.289740 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:19.291257 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:19.301996 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.302996 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.303889 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.305265 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:19.306311 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:19.307574 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:19.510943 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:19.520005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-18023718-5ff1-473a-ab16-476268af8dcf tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.234347 Aug 31 11:07:19.520584 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 572/1172] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:19 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:20.045983 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-c4c096e4-2388-4edc-9608-c0d056a54659 req-2f7c41e4-8b48-4255-98a0-55d07697b70a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8209532-4a64-42f4-8c59-21392e648851", "tag": "139c6071-5cef-4f3c-89a7-6d4a0420ab4a"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:20.065313 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-c4c096e4-2388-4edc-9608-c0d056a54659 req-2f7c41e4-8b48-4255-98a0-55d07697b70a service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:20.065815 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-c4c096e4-2388-4edc-9608-c0d056a54659 req-2f7c41e4-8b48-4255-98a0-55d07697b70a service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:20.066245 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-c4c096e4-2388-4edc-9608-c0d056a54659 req-2f7c41e4-8b48-4255-98a0-55d07697b70a service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:20.079138 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-c4c096e4-2388-4edc-9608-c0d056a54659 req-2f7c41e4-8b48-4255-98a0-55d07697b70a service nova] Creating event network-changed:139c6071-5cef-4f3c-89a7-6d4a0420ab4a for instance d8209532-4a64-42f4-8c59-21392e648851 on hv-cinder-79578 Aug 31 11:07:20.085562 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-c4c096e4-2388-4edc-9608-c0d056a54659 req-2f7c41e4-8b48-4255-98a0-55d07697b70a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043591 Aug 31 11:07:20.086370 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 601/1173] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:20.544763 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:20.545930 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:20.557401 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:20.558293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:20.559073 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:20.560186 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:20.560995 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:20.561736 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:20.775531 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:20.783505 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-62d126ed-f513-4d27-ac4d-efe761f43f92 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.245943 Aug 31 11:07:20.784118 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 573/1174] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:20 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:21.810539 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:21.811692 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:21.822317 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:21.823141 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:21.823856 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:21.824998 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:21.825703 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:21.826488 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:21.972179 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:21.980899 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-19c49e32-7d6f-4300-9585-323c67e2faa0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.178780 Aug 31 11:07:21.981464 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 602/1175] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:21 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:23.005575 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:23.006681 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:23.014954 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.015445 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.015863 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.016574 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:23.017026 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:23.017446 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:23.171397 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:23.179423 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-0dd68fe1-acb3-4d83-a80f-09750e1f4943 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.180559 Aug 31 11:07:23.180027 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 574/1176] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:22 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:24.204573 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:24.205595 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:24.216028 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:24.216517 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:24.216948 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:24.217650 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:24.218119 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:24.218566 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:24.359285 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:24.367482 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-02fd9105-5901-4085-a857-b5ff3a730a3c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.169492 Aug 31 11:07:24.368078 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 603/1177] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:24 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:25.390690 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:25.391327 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:25.398539 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:25.399047 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:25.399503 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:25.400239 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:25.400716 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:25.401165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:25.550970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:25.560158 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-bd26a4f8-9d45-4b1f-92f3-c46d8e8fdc85 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.174295 Aug 31 11:07:25.560707 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 575/1178] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:25 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:26.592828 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:26.593987 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:26.604819 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:26.605625 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:26.606398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:26.607133 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:26.607587 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:26.608020 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:26.752442 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:26.764297 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d1ea00b5-ed2a-4d5e-abe4-f782327db61e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.178434 Aug 31 11:07:26.764875 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 604/1179] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:26 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:27.789145 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:27.790130 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:27.793945 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell0:SELECT=2 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:27.802897 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.803695 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.804427 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.805576 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:27.806736 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:27.807618 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:27.948053 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:27.960165 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3f562687-dcd3-4846-b269-68acdb4d97a1 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.177335 Aug 31 11:07:27.960986 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 576/1180] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:27 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:28.983850 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:28.984489 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:28.986510 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=2 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:28.987177 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell0:SELECT=6 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:07:28.993914 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:28.994411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:28.994853 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:28.995557 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:28.996016 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:28.996421 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:29.144906 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:29.156451 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-d566751e-5b5e-40fa-a8d8-b5aad569c2ff tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.176945 Aug 31 11:07:29.157037 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 605/1181] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:28 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:30.181836 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:30.182892 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:30.191005 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.191492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.191930 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.192629 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.193082 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.193501 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.330820 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:30.338818 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-023dbcb7-f703-4464-8d42-1584ca6e3b24 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.164031 Aug 31 11:07:30.339391 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 577/1182] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:30 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:30.408180 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-674b72f5-1914-4ff4-97f0-429aa1e918b2 req-d51983c5-d529-4b71-9e02-90f20f6f3021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8209532-4a64-42f4-8c59-21392e648851", "name": "network-vif-plugged", "status": "completed", "tag": "139c6071-5cef-4f3c-89a7-6d4a0420ab4a"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:30.419693 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-674b72f5-1914-4ff4-97f0-429aa1e918b2 req-d51983c5-d529-4b71-9e02-90f20f6f3021 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:30.420315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-674b72f5-1914-4ff4-97f0-429aa1e918b2 req-d51983c5-d529-4b71-9e02-90f20f6f3021 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:30.420876 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-674b72f5-1914-4ff4-97f0-429aa1e918b2 req-d51983c5-d529-4b71-9e02-90f20f6f3021 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:30.435667 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-674b72f5-1914-4ff4-97f0-429aa1e918b2 req-d51983c5-d529-4b71-9e02-90f20f6f3021 service nova] Creating event network-vif-plugged:139c6071-5cef-4f3c-89a7-6d4a0420ab4a for instance d8209532-4a64-42f4-8c59-21392e648851 on hv-cinder-79578 Aug 31 11:07:30.440671 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-674b72f5-1914-4ff4-97f0-429aa1e918b2 req-d51983c5-d529-4b71-9e02-90f20f6f3021 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036409 Aug 31 11:07:30.441258 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 606/1183] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:07:31.362786 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:31.363414 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:31.370333 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.370818 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.371250 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.371960 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:31.372409 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:31.373479 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:31.524394 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:31.532797 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-1f7e35f1-9516-42ac-95a0-e72a20069800 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1267 microversion: 2.1 time: 0.175411 Aug 31 11:07:31.533369 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 578/1184] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:31 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:32.620373 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:32.621071 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:32.627553 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.627974 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.628400 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.629082 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.629550 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.630005 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.768925 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:32.778009 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-bd29d6ef-9738-4510-801c-8c2c00a5435c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1452 microversion: 2.1 time: 0.226264 Aug 31 11:07:32.778586 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 607/1185] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:32 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1452 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:32.798289 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:07:32.798905 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:07:32.805880 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.806714 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.807173 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.807868 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:32.808319 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:32.808742 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:32.948705 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:07:32.958904 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-dc1af068-eea3-416b-b3e0-0d4fc381000e tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1452 microversion: 2.1 time: 0.164607 Aug 31 11:07:32.959482 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 579/1186] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:07:32 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:07:34.921056 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-9f65ace0-d080-43f2-b8eb-327e38b4fa53 req-fba36041-fd46-4a71-ba78-28b2920aadfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8209532-4a64-42f4-8c59-21392e648851", "tag": "139c6071-5cef-4f3c-89a7-6d4a0420ab4a"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:07:34.931429 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-9f65ace0-d080-43f2-b8eb-327e38b4fa53 req-fba36041-fd46-4a71-ba78-28b2920aadfd service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:07:34.931915 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-9f65ace0-d080-43f2-b8eb-327e38b4fa53 req-fba36041-fd46-4a71-ba78-28b2920aadfd service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:07:34.932339 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-9f65ace0-d080-43f2-b8eb-327e38b4fa53 req-fba36041-fd46-4a71-ba78-28b2920aadfd service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:07:34.943686 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-9f65ace0-d080-43f2-b8eb-327e38b4fa53 req-fba36041-fd46-4a71-ba78-28b2920aadfd service nova] Creating event network-changed:139c6071-5cef-4f3c-89a7-6d4a0420ab4a for instance d8209532-4a64-42f4-8c59-21392e648851 on hv-cinder-79578 Aug 31 11:07:34.948586 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-9f65ace0-d080-43f2-b8eb-327e38b4fa53 req-fba36041-fd46-4a71-ba78-28b2920aadfd service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031333 Aug 31 11:07:34.949397 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 608/1187] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:16.376010 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_api:SELECT=20 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:16.376785 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG dbcounter [-] [120481] Writing DB stats nova_cell1:SELECT=48 {{(pid=120481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:16.377678 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:09:16.380592 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:16.381684 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG dbcounter [-] [120482] Writing DB stats nova_cell1:SELECT=44 {{(pid=120482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:09:16.381872 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Wed Aug 31 11:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 (ip 10.222.0.75) !!! Aug 31 11:09:16.389682 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-ed242970-aa92-4e56-aad8-32853b78792e req-1a6e8e6b-b27a-4400-9cbb-0e50616db85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8209532-4a64-42f4-8c59-21392e648851", "tag": "139c6071-5cef-4f3c-89a7-6d4a0420ab4a"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:16.394445 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 11:09:16.394620 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Wed Aug 31 11:09:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 (ip 10.222.0.75) !!! Aug 31 11:09:16.401699 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:16.402424 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:16.402619 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-ed242970-aa92-4e56-aad8-32853b78792e req-1a6e8e6b-b27a-4400-9cbb-0e50616db85f service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:16.402988 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-ed242970-aa92-4e56-aad8-32853b78792e req-1a6e8e6b-b27a-4400-9cbb-0e50616db85f service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:16.403418 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-ed242970-aa92-4e56-aad8-32853b78792e req-1a6e8e6b-b27a-4400-9cbb-0e50616db85f service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:16.415433 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:16.415679 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-ed242970-aa92-4e56-aad8-32853b78792e req-1a6e8e6b-b27a-4400-9cbb-0e50616db85f service nova] Creating event network-changed:139c6071-5cef-4f3c-89a7-6d4a0420ab4a for instance d8209532-4a64-42f4-8c59-21392e648851 on hv-cinder-79578 Aug 31 11:09:16.415981 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:16.416495 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:16.417280 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:16.417802 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:16.418289 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:16.420442 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-ed242970-aa92-4e56-aad8-32853b78792e req-1a6e8e6b-b27a-4400-9cbb-0e50616db85f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046859 Aug 31 11:09:16.421027 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 609/1188] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:16.453271 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:09:16.538665 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-63deaf34-3fc0-4f19-84da-18bf70f9721a tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 204 len: 0 microversion: 2.1 time: 0.167426 Aug 31 11:09:16.539599 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 580/1189] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:09:16 2022] DELETE /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:09:16.549695 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:16.550932 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:16.558978 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:16.559477 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:16.559905 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:16.560757 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:16.561208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:16.561627 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:16.710742 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:16.719200 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-0f3f8b04-6c63-486b-bf2d-9c37edc99953 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1577 microversion: 2.1 time: 0.174556 Aug 31 11:09:16.719788 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 610/1190] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:16 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:17.746002 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:17.747228 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:17.755288 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:17.755777 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:17.756212 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:17.760306 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:17.760306 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:17.760306 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:17.966122 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:17.977387 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6f0b694a-b19d-4beb-b280-509724b7cdb0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1577 microversion: 2.1 time: 0.238557 Aug 31 11:09:17.978240 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 581/1191] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:17 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:18.917519 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-5f55e05c-4862-4fd5-8435-4b9970c061bd req-509a5c2f-c531-4832-9010-c3cdbeff1882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8209532-4a64-42f4-8c59-21392e648851", "name": "network-vif-deleted", "tag": "139c6071-5cef-4f3c-89a7-6d4a0420ab4a"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:18.928012 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-5f55e05c-4862-4fd5-8435-4b9970c061bd req-509a5c2f-c531-4832-9010-c3cdbeff1882 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:18.928495 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-5f55e05c-4862-4fd5-8435-4b9970c061bd req-509a5c2f-c531-4832-9010-c3cdbeff1882 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:18.928959 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-5f55e05c-4862-4fd5-8435-4b9970c061bd req-509a5c2f-c531-4832-9010-c3cdbeff1882 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:18.940469 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-5f55e05c-4862-4fd5-8435-4b9970c061bd req-509a5c2f-c531-4832-9010-c3cdbeff1882 service nova] Creating event network-vif-deleted:139c6071-5cef-4f3c-89a7-6d4a0420ab4a for instance d8209532-4a64-42f4-8c59-21392e648851 on hv-cinder-79578 Aug 31 11:09:18.945857 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-5f55e05c-4862-4fd5-8435-4b9970c061bd req-509a5c2f-c531-4832-9010-c3cdbeff1882 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031689 Aug 31 11:09:18.946201 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 611/1192] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:19.001975 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:19.002616 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:19.009498 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.010090 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.010515 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.011247 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:19.011683 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:19.012136 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:19.081511 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:19.089547 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-6d3605f7-6bd8-4442-8d9d-352ee3d3943b tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 200 len: 1226 microversion: 2.1 time: 0.092815 Aug 31 11:09:19.090162 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 582/1193] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:18 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:20.115598 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:20.116667 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: d8209532-4a64-42f4-8c59-21392e648851] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:20.126832 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:20.127312 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:20.127753 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:20.128446 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:20.128903 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:20.129341 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:20.143094 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] HTTP exception thrown: Instance d8209532-4a64-42f4-8c59-21392e648851 could not be found. Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Request method failure captured: Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 HTTP/1.1 Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz_Bw2ACGMmsEHJ359oc6bb5ef0dIcw1gzCuslprztUbVQX7CgLs8x8hDNjIyOR7fUIFRRth-tN132bF-2BfgKZf4Jpl84GAvDM6YVN5KJrsQLXQrZlytzQ-uJv3E1X0u5YEyTotVA2FRUfY9aK3dtHYHznvyy3hlYawUOP9mdraGQA Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:09:20.144738 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fdd5d77d519c46689286cec82a24d9b7"}]}] Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 951b4d24f5c4460db22218f94ded0c57 Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance d8209532-4a64-42f4-8c59-21392e648851 could not be found. Aug 31 11:09:20.146607 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'd8209532-4a64-42f4-8c59-21392e648851'} Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8209532-4a64-42f4-8c59-21392e648851 could not be found. Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:09:20.147741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8209532-4a64-42f4-8c59-21392e648851 could not be found. Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8209532-4a64-42f4-8c59-21392e648851 could not be found. Aug 31 11:09:20.149820 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:20.151492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Returning 404 to user: Instance d8209532-4a64-42f4-8c59-21392e648851 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:09:20.151492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-ea89814a-44be-4c6b-9617-37819aa27097 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851" status: 404 len: 111 microversion: 2.1 time: 0.037749 Aug 31 11:09:20.151492 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 612/1194] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:20 2022] GET /compute/v2.1/servers/d8209532-4a64-42f4-8c59-21392e648851 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:09:23.310728 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:23.311265 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:23.319293 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.319786 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.320214 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.320914 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.321359 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.321795 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.353190 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Going to try to terminate instance {{(pid=120481) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 11:09:23.374159 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-2f35e393-51b9-49a6-a156-95a7763191b0 req-239a9824-c296-45f9-ab96-3e8880eb111e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f459a161-9137-4822-8b74-5a3ae7204249", "tag": "cc8825cb-948e-413c-a8a1-fab68a1da0d6"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:23.384741 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-2f35e393-51b9-49a6-a156-95a7763191b0 req-239a9824-c296-45f9-ab96-3e8880eb111e service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.385225 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-2f35e393-51b9-49a6-a156-95a7763191b0 req-239a9824-c296-45f9-ab96-3e8880eb111e service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.385650 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-2f35e393-51b9-49a6-a156-95a7763191b0 req-239a9824-c296-45f9-ab96-3e8880eb111e service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.397707 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-2f35e393-51b9-49a6-a156-95a7763191b0 req-239a9824-c296-45f9-ab96-3e8880eb111e service nova] Creating event network-changed:cc8825cb-948e-413c-a8a1-fab68a1da0d6 for instance f459a161-9137-4822-8b74-5a3ae7204249 on hv-cinder-79578 Aug 31 11:09:23.403536 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-2f35e393-51b9-49a6-a156-95a7763191b0 req-239a9824-c296-45f9-ab96-3e8880eb111e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093723 Aug 31 11:09:23.404472 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 613/1195] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 11:09:23.446898 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-873a3bd4-e0d8-4989-8e91-96b3a97ad358 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "DELETE /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 204 len: 0 microversion: 2.1 time: 0.137681 Aug 31 11:09:23.450747 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 583/1196] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:09:23 2022] DELETE /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 11:09:23.456576 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:23.457291 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:23.463640 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.464171 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.464610 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.465318 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:23.465785 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:23.466222 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:23.602494 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.policy [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120482) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:23.610750 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-7f63db6c-e27a-4b37-8a01-4437e0d4efed tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1576 microversion: 2.1 time: 0.158595 Aug 31 11:09:23.611321 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 614/1197] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:23 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 11:09:24.637508 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:24.638669 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:24.646021 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:24.646492 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:24.646922 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:24.647615 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:24.648062 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:24.648486 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:24.860153 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:24.868319 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-a6cc57d9-928a-4e00-9da7-ba75f24ac3c0 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1576 microversion: 2.1 time: 0.238080 Aug 31 11:09:24.868885 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 584/1198] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:24 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1576 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:25.802489 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [req-d1b163b7-93ce-40a6-b4be-3d73992ba97a req-71457038-8662-44c3-8ce2-6b8467b05db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f459a161-9137-4822-8b74-5a3ae7204249", "name": "network-vif-deleted", "tag": "cc8825cb-948e-413c-a8a1-fab68a1da0d6"}]} {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 11:09:25.813227 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-d1b163b7-93ce-40a6-b4be-3d73992ba97a req-71457038-8662-44c3-8ce2-6b8467b05db8 service nova] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:25.813699 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-d1b163b7-93ce-40a6-b4be-3d73992ba97a req-71457038-8662-44c3-8ce2-6b8467b05db8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:25.814158 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [req-d1b163b7-93ce-40a6-b4be-3d73992ba97a req-71457038-8662-44c3-8ce2-6b8467b05db8 service nova] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:25.827761 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.compute.server_external_events [req-d1b163b7-93ce-40a6-b4be-3d73992ba97a req-71457038-8662-44c3-8ce2-6b8467b05db8 service nova] Creating event network-vif-deleted:cc8825cb-948e-413c-a8a1-fab68a1da0d6 for instance f459a161-9137-4822-8b74-5a3ae7204249 on hv-cinder-79578 Aug 31 11:09:25.832739 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [req-d1b163b7-93ce-40a6-b4be-3d73992ba97a req-71457038-8662-44c3-8ce2-6b8467b05db8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034173 Aug 31 11:09:25.833398 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 615/1199] 10.222.0.75 () {64 vars in 1317 bytes} [Wed Aug 31 11:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 11:09:25.889805 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:25.890432 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:25.897009 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:25.897494 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:25.897954 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:25.898716 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:25.899164 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:25.899643 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:25.965611 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.policy [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '951b4d24f5c4460db22218f94ded0c57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd5d77d519c46689286cec82a24d9b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120481) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 11:09:25.974875 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-9667dc64-6ff6-479c-977d-b0574cc7166c tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 200 len: 1225 microversion: 2.1 time: 0.089227 Aug 31 11:09:25.975413 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 585/1200] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:25 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 11:09:27.002034 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:27.003252 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: f459a161-9137-4822-8b74-5a3ae7204249] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:27.013817 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.014637 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.015372 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.016403 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.016862 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.017282 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.031006 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] HTTP exception thrown: Instance f459a161-9137-4822-8b74-5a3ae7204249 could not be found. Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Request method failure captured: Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 HTTP/1.1 Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz_Bw2ACGMmsEHJ359oc6bb5ef0dIcw1gzCuslprztUbVQX7CgLs8x8hDNjIyOR7fUIFRRth-tN132bF-2BfgKZf4Jpl84GAvDM6YVN5KJrsQLXQrZlytzQ-uJv3E1X0u5YEyTotVA2FRUfY9aK3dtHYHznvyy3hlYawUOP9mdraGQA Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:09:27.032632 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fdd5d77d519c46689286cec82a24d9b7"}]}] Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 951b4d24f5c4460db22218f94ded0c57 Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance f459a161-9137-4822-8b74-5a3ae7204249 could not be found. Aug 31 11:09:27.034315 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': 'f459a161-9137-4822-8b74-5a3ae7204249'} Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f459a161-9137-4822-8b74-5a3ae7204249 could not be found. Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:09:27.035411 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f459a161-9137-4822-8b74-5a3ae7204249 could not be found. Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f459a161-9137-4822-8b74-5a3ae7204249 could not be found. Aug 31 11:09:27.036954 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.038407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Returning 404 to user: Instance f459a161-9137-4822-8b74-5a3ae7204249 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:09:27.038407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-6116948f-faa3-4193-90b6-531e99d2b4c8 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249" status: 404 len: 111 microversion: 2.1 time: 0.040243 Aug 31 11:09:27.038407 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 616/1201] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:26 2022] GET /compute/v2.1/servers/f459a161-9137-4822-8b74-5a3ae7204249 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:09:27.487110 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:27.487671 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.compute.api [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120481) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:27.494491 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.494976 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.495408 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.496101 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.496549 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.496970 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG oslo_concurrency.lockutils [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120481) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.510589 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.wsgi [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] HTTP exception thrown: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Request method failure captured: Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: request: DELETE /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 HTTP/1.1 Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept: application/json Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Accept-Encoding: identity Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Connection: close Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Length: 0 Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Content-Type: application/json Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Host: 10.222.0.75 Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: Openstack-System-Scope: None Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: User-Agent: python-urllib3/1.26.12 Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Auth-Token: gAAAAABjDz_Bw2ACGMmsEHJ359oc6bb5ef0dIcw1gzCuslprztUbVQX7CgLs8x8hDNjIyOR7fUIFRRth-tN132bF-2BfgKZf4Jpl84GAvDM6YVN5KJrsQLXQrZlytzQ-uJv3E1X0u5YEyTotVA2FRUfY9aK3dtHYHznvyy3hlYawUOP9mdraGQA Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Id: None Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Domain-Name: None Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Identity-Status: Confirmed Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Is-Admin-Project: True Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Id: default Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Domain-Name: Default Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Project-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Role: reader,member Aug 31 11:09:27.512234 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Roles: reader,member Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fdd5d77d519c46689286cec82a24d9b7"}]}] Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-Tenant-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Id: default Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Domain-Name: Default Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Id: 951b4d24f5c4460db22218f94ded0c57 Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: X-User-Name: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: method: > Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: exception: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.514067 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: action_args: {'id': '762fcaf1-82a4-4193-a52e-7291b50424d6'} Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:09:27.515029 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.516458 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.517943 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Returning 404 to user: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. {{(pid=120481) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:09:27.517943 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-3fe861a9-c43a-4378-9792-77ef1a8db3b3 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "DELETE /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 404 len: 111 microversion: 2.1 time: 0.031058 Aug 31 11:09:27.517943 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 586/1202] 10.222.0.75 () {58 vars in 1239 bytes} [Wed Aug 31 11:09:27 2022] DELETE /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:09:27.522831 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '>' {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:27.523437 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.compute.api [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] [instance: 762fcaf1-82a4-4193-a52e-7291b50424d6] Fetching instance by UUID {{(pid=120482) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 11:09:27.529580 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.530096 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.530526 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.531208 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Acquiring lock "05e8ed1e-1228-4051-ab88-71c736654b3f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 11:09:27.531651 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 11:09:27.532130 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG oslo_concurrency.lockutils [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Lock "05e8ed1e-1228-4051-ab88-71c736654b3f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120482) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 11:09:27.545882 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.wsgi [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] HTTP exception thrown: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Request method failure captured: Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: request: GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 HTTP/1.1 Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept: application/json Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Accept-Encoding: identity Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Connection: close Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Length: 0 Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Content-Type: application/json Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Host: 10.222.0.75 Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: Openstack-System-Scope: None Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: User-Agent: python-urllib3/1.26.12 Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Auth-Token: gAAAAABjDz_Bw2ACGMmsEHJ359oc6bb5ef0dIcw1gzCuslprztUbVQX7CgLs8x8hDNjIyOR7fUIFRRth-tN132bF-2BfgKZf4Jpl84GAvDM6YVN5KJrsQLXQrZlytzQ-uJv3E1X0u5YEyTotVA2FRUfY9aK3dtHYHznvyy3hlYawUOP9mdraGQA Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Id: None Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Domain-Name: None Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Identity-Status: Confirmed Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Is-Admin-Project: True Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Id: default Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Domain-Name: Default Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Project-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Role: reader,member Aug 31 11:09:27.548074 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Roles: reader,member Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.75:8080", "publicURL": "http://10.222.0.75:8080/v1/AUTH_fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/volume/v3/fdd5d77d519c46689286cec82a24d9b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.75/compute/v2/fdd5d77d519c46689286cec82a24d9b7"}]}] Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Id: fdd5d77d519c46689286cec82a24d9b7 Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-Tenant-Name: tempest-TestVolumeBootPattern-1042166727 Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Id: default Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Domain-Name: Default Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Id: 951b4d24f5c4460db22218f94ded0c57 Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: X-User-Name: tempest-TestVolumeBootPattern-1042166727-project Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: method: > Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: exception: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.549794 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: action_args: {'id': '762fcaf1-82a4-4193-a52e-7291b50424d6'} Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: {{(pid=120482) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 11:09:27.550838 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. Aug 31 11:09:27.552756 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: ERROR nova.api.openstack.wsgi Aug 31 11:09:27.554384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: DEBUG nova.api.openstack.wsgi [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Returning 404 to user: Instance 762fcaf1-82a4-4193-a52e-7291b50424d6 could not be found. {{(pid=120482) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 11:09:27.554384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: INFO nova.api.openstack.requestlog [None req-9be20128-c16c-4d08-a45d-077f7169ed1d tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6" status: 404 len: 111 microversion: 2.1 time: 0.030614 Aug 31 11:09:27.554384 dv-cinder-795785-12-iscsi devstack@n-api.service[120482]: [pid: 120482|app: 0|req: 617/1203] 10.222.0.75 () {58 vars in 1236 bytes} [Wed Aug 31 11:09:27 2022] GET /compute/v2.1/servers/762fcaf1-82a4-4193-a52e-7291b50424d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 11:09:28.864346 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: DEBUG nova.api.openstack.wsgi [None req-140e13af-335e-4921-9222-d81715aea491 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] Calling method '.version_select at 0x7f37a8c22040>' {{(pid=120481) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 11:09:28.891861 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: INFO nova.api.openstack.requestlog [None req-140e13af-335e-4921-9222-d81715aea491 tempest-TestVolumeBootPattern-1042166727 tempest-TestVolumeBootPattern-1042166727-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1207752644" status: 202 len: 0 microversion: 2.1 time: 0.031563 Aug 31 11:09:28.892422 dv-cinder-795785-12-iscsi devstack@n-api.service[120481]: [pid: 120481|app: 0|req: 587/1204] 10.222.0.75 () {58 vars in 1263 bytes} [Wed Aug 31 11:09:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1207752644 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)